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decision makers in rural settings to develop the best possible 
educational experiences for preparing students to meet the demands of 
our changing society by linking small rural schools with their state 
agency’s resources. Project SPREAD proposed to establish in Colorado 
the capability to diffuse improved practices by creating diffusion 
units. Later a diffusion unit would be activated in Utah, Wyoming, 
and Washington based on the test of Colorado’s preliminary 
activities. The procedures entailed creating an organization in the 
Colorado State Department of Education, analyzing the past diffusion 
efforts of the state department, studying the structural changes 
needed in the state department to form a diffusion unit, developing a 
formative evaluation plan, developing a model for the diffusion 
organization, and writing a first version of a guidebook for 
improving small rural schools. Each procedure is described in this 
report, along with the findings and recommendations; in part, these 
are that state educational agencies are in a unigue pivotal position 
to provide the diffusion linkage between small rural schools and all 
other agencies; small rural schools can be an easily managed 
laboratory site; everyone involved in a cooperative improvement 
effort requires training; and all diffusion procedures and strategies 
need to be tested in an operational setting over a long period of 
time, until all can be made to work reliably. (JB) 
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FOREWORD AND PREFACE 



The past two decades have been marked by considerable school district 
reorganization in the four Project states. As a result, almost all of the 
small rural schools in Colorado, Utah, Washington, and Wyoming meet the 
criteria for economically feasible necessarily existent small schools. 

However, the problem of educating youngsters in remote or sparsely populated 
areas remains. Faced with the fact that school district reorganization of 
itself cannot solve this small rural school problem, the states involved turn 
to comprehensive school improvement efforts. Methods of linking these small 
rural schools with their state agency's resources were seen as a way of 
solving the problem. 

Most small rural schools lag behind other schools in adopting proven new 
school practices. This lag in adopting improved practices has widened more in 
small rural schools because these schools lack procedures for sensing needs, 
translating research results into practice, mobilizing resources, and for 
locally adopting improved practices. No where in our educational system is 
this gap between what we do and what we know so pronounced and so critical as 
it is in small rural schools. The goal of Project SPREAD is to assist edu- 
cators and decision makers in rural settings to develop the best possible 
educational experiences for preparing students to meet the demands of our 
changing society. Project SPREAD was envisioned as a special purpose one-time 
four- state organization for studying methods and procedures to spread improved 
school practices into small rural schools. It stresses cooperative efforts of 
these schools, the state educational agencies, and other educational agencies. 
Most state educational agencies attempt to accomplish diffusion (spread of 
practice) on a fragmented basis within each of their own sub-units. Project 
SPREAD proposed to form a diffusion unit in each of the participating state 
agencies which would, working cooperatively, develop models and strategies for 
accomplishing diffusion. 

The end purpose of Project SPREAD is not to develop specific innovations, 
improved school practices, or experimental programs, although, it will do all 
of these, its purpose is to develop a way of life for educators ... a planful, 
rational approach to meeting the needs of a changing world so that students in 
small rural ■ schools may receive the best possible educational experiences. In 
addition, state educational agencies would also benefit by learning more about 
how to cooperate in providing better services that directly affect youngsters 
in these schools, thus, moving the state educational agency away from exporting 
categorical programs and toward cooperative efforts which more directly affect 
youth. 

The Project Director wishes to express his appreciation to, the members of 
the Policy Board for their leadership, guidance, and direction during the past 
two years. Members of the Policy Board are: Commissioner Byron W. Hansford, 

Chairman, Colorado; State Superintendent Walter D. Talbot, Utah; State 
Superintendent Louis Bruno, Washington; and, former State Superintendent Harry 
Roberts, Wyoming. 



The assistance of the Project’s consultants, Bruce Monroe, Instructional 
Systems Group, Los Angeles, California and Garth Sorenson, Professor, University 
of California at Los Angelos, was of great value. The support and advice of 
the State Representatives was also valuable. The State Representatives are: 

Rowan C. Stutz, Russell G. Merrell, and Kenneth Lindsay, Utah; Harold Smith 
and Alan Metcalf, Washington ; Roger Hanson and Mel Gillespie, Wyoming. 

The Project Director wishes to express his appreciation to the members 
of the Advisory Committee for their counsel. Members are: Russell B. 

Vlaanderen, Chairman, Educational Commission of the States, Denver, Colorado; 

R. C. Mercure, Group Vice President, Ball Corporation, Boulder, Colorado; 

Ray Kimball, Executive Secretary, Colorado Association of Commerce and Industry, 
Denver, Colorado; Arthur Branscombe, Editorial Staff, The Denver Post, Denver, 
Colorado; Lome Woollatt, Associate Commissioner, Research and Evaluation, 

New York State Education Department, Albany, New York; Lynne Svenning, Consultant, 
Sausalito, California. 

Special appreciation is extended to the following staff members of the 
Colorado Department of Education for their contributions to the work of this 
Project. They are: Dorothy Branting, Secretary; Richard D. Taylor, Field 

Representative; K. Douglas Bassett, Communications Unit Director; and, E. Dean 
Coon, Assistant Commissioner. 




Edwin P. Hildebrand 
Project Director 
June 30, 1971 







AUTHOR’S ABSTRACT 



The purpose of Project SPREAD is to aid students attending small rural 
schools by improving local educational programs. State educational agencies 
will also benefit by learning more about how to participate in cooperative 
efforts, providing resources, referral, and technical services needed to 
assist local adoption of improved practices. In the simplest terms, the 
Project calls for the development of a "diffusion entity" in the state de- 
partments of Colorado, Utah, and Washington which will, in the main, be 
comprised of existing personnel and funding. 

The Project has developed a working Model and Guidebook to assist all 
who participate in cooperative efforts by guiding their efforts in building 
and maintaining linkages, diffusion procedures, and school improvement 
efforts . 

This Project builds upon principles learned in a series of small school 
improvement projects. Project SPREAD has invested two years in the planning, 
research, and development of this prototype diffusion Model. This Model, 
with its procedures, guidelines, and training materials, needs to be tested 
in an increasingly larger geographic area, in increasingly more "resistant" 
sites, and with increasingly more complex improved school practices. As a 
result of these tests, formative evaluation will gradually improve all of 
the above, until workable procedures exist. 
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CHAPTER ONE 



I . INTRODUCTION 



The format to bo followed in this report is mandated by the Revised Scope 
of Work Unit Statements IV, Reporting the Project, Item C, and is quoted, as 
follows : 



"The Project Director will provide quarterly progress 
reports on accomplishments, problems encountered, posed 
solutions, and work to be accomplished over the ensuing 
quarter, and a final report that describes and documents 
the key phases of the program, key decisions that were 
made, inputs, activities and products, and outputs for 
each phase, and estimated resource requirements for 
spreading the program to the other participating state 
departments of education." 

Therefore, this report begins by stating the problem. The procedures 
used to carry out this research are described in Chapter Two and are entitled, 
"Key Phases of the Program." These key phases are described under the following 
categories: key decisions, inputs, activities and products, and outputs for 

each of the key phases. 

Chapter Three will describe the Project products and includes the estimates 
of the resources required for spreading the program to other participating state 
departments of education. 

Chapter Four provides information about the results, conclusions, and recom- 
mendations of the Project. 



II. STATEMENT OF TIE PROBLEM 

On April 30, 1969, the Colorado Department of Education transmitted to the 
U. S. Office of Education, Bureau of Educational Research, a proposal to ac- 
tivate Project SPREAD (State Programs Revitalizing Education £nd Diffusion) in 
the four state departments of education of Colorado, Utah, ’Wyoming, and Washington. 
There four states would establish a diffusion unit in their state department of 
education, and develop and test a model for diffusion by demonstrating it in 
the small rural schools of these states. 

These four states, located in the Western part of the United States, have 
had up to ten years experience in various multi-state school improvement projects, 
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and, particularly , those that have dealt with educational problems in rural areas. 
To date, they have found few successful diffusion models. There are several 
reasons why there is a lack of such models appropriate to rural areas. First, 
rurality has the effect of isolating or removing from the mainstream of educational 
information and diffusion schools found in rural areas. Second, rural schools 
often lack quality. The President's National Advisory Commission on Rural Poverty 
reported that "rural adults and youth are the product of an educational system 
that has historically shortchanged rural people. The extent to which rural people 
have been denied equality of educational opportunity is evident from both the 
product of the educational system and the resources that have gone into that 
system." So, small rural schools do not learn about new practices nor do they 
have the resources with which to bring about a massive diffusion and improvement 
efforts. In short, then, the problem is that rural small schools lack the benefit 
of a development and diffusion improvement effort which could be supplied by 
their state departments of education we re these state agencies equipped to do so. 
Project SPREAD proposed to establish in the four state departments of education 
the capability to diffuse improved practices by creating diffusion units in each, 
of the states. Based on their past experience, the states would develop a model 
and strategies of diffusion and test these models and strategies in their small 
rural schools. 



The state departments of education would demonstrate the workability of 
this model and continue to improve the strategies until they predictably worked. 
Involved in accomplishing this task is the need to increase the expertise of 
the Project staff, the staffs of the state departments of education, ard the 
local pilot demonstration school staffs in developing good diffusion procedures. 

It also requires the institutionalization in each of the state departments the 
function and process of diffusion in order that promising practices may be 
spread rapidly into all schools of the several states. This proposal was not 
funded due to the lack of available funds. However, it was determined that a 15 — 
month planning grant would be funded. This $113,990 15-month planning grant was 
later extended nine more months. The planning grant was made only to the 
Colorado Department of Education to test diffusion strategies in the Colorado 
Department of Education, thus, eliminating the other three states from action 
participation in the Project and delegating them to a role of observing what 
Colorado did in the planning grant period. The problems created by this decision 
soon became evident. 

Thus, the proposal to establish Project SPREAD as a four-state effort and 
to establish diffusion units in the four state departments of education, became 
instead a one-state effort (with the other three states observing and re- 
acting) to plan and test diffusion strategies in Colorado. Later, in another 
grant, a diffusion unit would be activated in all states based on the test of 
Colorado's preliminary activities during the planning grant (these activities 
are described in the Scope of Work Unit Statements to be found in Appendix A of 
this report). 
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CHAPTER TWO 



1 * procedures 

The procedures to be followed in the work plan can be found in Appendix A, 
Scope of Work Unit Statement Revised. Basically, they entailed creating an 
organization in the Colorado Department of Education, analyzing the past dif- 
fusion efforts of the Colorado Department, studying the structural changes 
needed in the Department to form a diffusion unit, developing a formative 
evaluation plan, developing a model for the diffusion organization, and writing 
a first version of a guidebook for improving small rural schools. 



II. KEY PHASES OF THE PRCGRAM 



A. Creating the Organization 



1 . 



2 . 



3 . 

4 . 



5 . 

6 . 



7 . 



8 . 

9 . 



10 . 



The Chief State School Officers involved in Project 
SPREAD formed a Policy Board. 

The Policy Board agreed to establish an Advisory 
Committee . 

The Policy Board agreed to hire the staff required. 

The Policy Board elected officers, making Byron W. 
Hansford, Colorado Commissioner, the chairman. 

The Policy Board adopted By-Laws for the organization. 
The Policy Board ratified the hiring of Edwin P. 
Hildebrand as Project Director, and Richard Taylor as 
Field Director. They also approved the hiring of two 
secretaries . 

The Policy Board appointed State Representatives from 
each of the other three participating states. 

The Project Director held staff orientation meetings. 
The Policy Board suggested nominees for consultants 
to assist in developing the evaluation mechanism. 
Colorado reported it was developing a Dissemination 
and Diffusion Task Force as one of seven major Task 
Forces within Colorado to study the emerging 
problems facing public education within this state. 



The main problem encountered was the decision made prior to the start of 
the Project that resulted in funding only a planning grant and not funding it 
in the amount required to include the salaries of at least one person in each 
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of the other three states. The result was a lack of involvement and commit- 
ment by the observer states in the activities of the Project. 

NOTE: A complete description of the above phase and the key decisions} in- 

cluding the inputs, activities and products, and outputs, can be found in the 
Quarterly Progress Report, June 25, 1969 to September 30, 1969. 




B . Developing the Organization and Planning the Project 

1. The Policy Board recommended that each state adopt 
a Resolution of Commitment to Project SPREAD. 

2. The Policy Board approved the function and roles 
of the Advisory Committee, and directed that the 

• nominees be suggested to the Policy Board for 
selection. 

3. The Policy Board approved the appointment of Dr. 

Garth Sorenson, of U.C.L.A., as consultant to assist 
in the development of the evaluation mechanism. 

4. The Policy Board approved the selection of INSGROUP, 

Dr. Bruce Monroe, Manager, to conduct the "Analysis 
of the Diffusion Practices in the Colorado 
Department of Education." 

5. The Policy Board heard a report on the work of the 
Colorado Dissemination and Diffusion Task Force. 

6. The Policy Board held a meeting on November 15-16, 

1969 in Phoenix, .Arizona, 

7. The Policy Board reviewed a report of the staff 
meeting held on October 28-29, 1969 in Salt Lake 
City, Utah, 

8. The Policy Board heard a report on the activities 
involved in gathering information for the INSGROUP 
Analysis . 

9. The Policy Board heard a report on the work of 
planning the Project, specifically in the following 
activities: 

a. Identifying the problem 

b. Defining the problem 

c. Analyzing the problem 

d. Developing the Project Objectives 

e. Developing the diffusion models and procedures 

' The main problem encountered during this phase centered around the confusion 
between the Scope of Work Unit Statements, which had been developed by the U. S. 
Office of Education staff, and the Objectives of the Project, as approved by the 
Policy Board. 

NOTE: A complete description of the above phase and key decisions, including the 

inputs, activities and products, and outputs, can be found in the Quarterly 
Progress Report, October 1, 1969 to December 31, 1969. 
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C . Continue no the Pla nr rin g of the Project, Bog-Inning the Analysis of 
Diffus:ion Practices , Conducting the Study of Organizational and 
Struc tural Changes Needed to Form a Diffu sion Unit. and broadenl oq 
of the IjTVolvement of the Project vvith Other Similar Activities 

1. The Project staff completed the collection of the in- 
formation needed by INSGROUP to accomplish the 
"Analysis of Diffusion Practices in the Colorado 
Department of Education." 

2. The Project Director arranged for State Representati ves 
to meet with the Colorado Dissemination and Diffusion 
Task Force and observe their activities. 

3. The Project Director made recommendations to the 
Colorado Department of Education Administrative Council 
on the organizational and structural arrangements 
needed to activate the diffusion function in the re- 
organized Colorado Department of Education. 

4. The Project staff continued the work of planning the 
Project by further refining the identification of the 
problem, the definition of the problem, the analysis 
of the problem, development of the Project objectives, 
and the development of diffusion models and procedures. 

5. The Project Director continued working with Dr. Garth 
Sorenson in developing the formative evaluation 
mechanism for the Project. 

6. The Project Director completed arrangements to include 
the four states involved in Project SPREAD in a 
Six-State Retrieval Center Project sponsored by the 
Northern Colorado Board of Cooperative Services. 

7. The Project Director completed arrangements for the 
Colorado Department of Education and the University of 
Denver to submit a proposal to conduct Institutes on 
"Implementing Innovation Through External Change Agents," 
to the U. S. Office of Education. 

8. The Project staff held a State Representative meeting 
January 14, 1970 in Denver. 

9. The Project Director met with the U. S. Office of 
Education Review Panel on Project SPREAD in Washington, 

D. C., on February 11, 1970. 

10. The Project Director held a State Representative Staff 
meeting on February 20, 1970. 

11. The Project Director held a State Representative meeting 
on March 23, 1970. 

The problem encountered during this phase was the decision to reorganize 
the' Colorado Department of Education prior to the completion of Project SPREAD'S 
"Analysis of Diffusion Practices." The timing of this decision made it difficult 
because INSGROUP' s study was not finalized yet, and this made it difficult to 
make reco/rwendations about the organizational and structural arrangements needed 
to activate a diffusion function in Colorado. 

NOTE: A complete description of the above phase and the key decisions, including 

the inputs, activities and products, and outputs, can be found in the Quarterly 
Progress Report, January 1, 1970 to March 31, 1970. 
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D. Pre paring for and Accomo .1 1 shj ng the Onsite Review and Continuing 
the Work of the? Previous Phases 

3. The Project Director prepared documents describing 
the Project's progress to date for the U. S. Office 
of. Education Onsite Review Team visit which was held 
in Denver on May 13-14, 1970. 

2. The Project staff spent considerable time discussing 
the taped oral comments made at the feedback session 
by the Onsite Review Committee. 

3. The Project staff developed comments to reply to the 
Onsite Review Committee's oral report. 

4. Several members of the Advisory Committee, who had 
been selected earlier, found they had to resign and 
were replaced by appropriate candidates. 

5. INSGROUP's Technical Report, "The Diffusion Practices 
of the Colorado Department of Education," was com- 
pleted and compared with the "Final Report" of the 
Colorado Dissemination and Diffusion Task Force. An 
analysis showed there was general agreement between 
both reports. 

6o The Project Director developed a one-page Statement 
of the Problem, a one-page list of Assumptions, and 
a five-page Erief Explanation of Project SPREAD, as 
a result of the recommendation of the Onsite Review 
Committee. 

7. The Project Director held a State Representative 
staff meeting on May 14, 1970. 

8. The Project Director arranged a briefing conference 
on April 20-21, 1970 for all Unit Directors in the 
Colorado Department of Education concerning the 
INSGROUP Technical Report. (See Appendix B, INSGROUP 

.Technical Report.) 

The problem encountered during this phase was the confusion concerning the 
format upon which the progress of the Project was to be assessed. The previously 
agreed upon format was changed by the Review Committee which necessitated the 
hurried rearrangement of the Project documentation, and the unilateral decision 
by the Review Team to use an outdated Flow Chart resulted in considerable con- 
fusion during the Onsite Review. 

NOTE: A complete description of the above phase and the key decisions, including 

the inputs, activities and products, and outputs, can be found in the Quarterly 
Progress Report, April 1, 1970 to June 30, 1970. 



E. Revising the Scope of Work, Extending the Grant Period, and Bringing 
Precj-sion to the Project 

1. The Project staff developed a revised set of Scope of Work 
Unit Statements for submission to the new Project Monitoring 
Officer. 

2. The Project product which will result from completion of the 
above revised Scope of Work Unit Statements will be a guidebook 




entitled "Organizing Cooperative Efforts to Improve 
Small Rural Schools." 

3. The Project Director developed feedback forms to 
assist In obtaining feedback from the State 
Representatives concerning their observation of the 
Colorado activities. 

4. The Project Director prepared a reply to the Onsite 
Review Report which was submitted to the Project 
Monitoring Officer. 

5. The Project staff began the development of a state- 
ment of the design for formative evaluation, and an 
abstract of the goal, objectives, and activities to 
be accomplished in Project SPREAD. 

6. A copy of the Brief Explanation of Project SPREAD 
was sent to the members of the Advisory Committee 
for their critique. 

7. The Project staff spent considerable time in devel- 
oping an outline for the Guidebook entitled, 

"Organizing Cooperative Efforts to Improve Small 
Rural Schools," and preliminary discussions were 
held concerning the selection of a site for testing 
the Guidebook. 

The major problems encountered during this phase concerned the difficulty 
of scheduling the Advisory Committee meeting because of the members' busy sched- 
ules. The appointment of Dr. Lewis R. Crum, Research Director, Region VIII, 
Office of the U. S. Office of Education, as Project Monitoring Officer, and the 
extending of the planning time were both of great assistance in bringing cor- 
rection to the activities of the Project. However, the failure to increase 
funding for the extended time so as to alleviate the problem of non-funded State 
Representatives has continued to plague the Project. 

NOTE: A complete description of the above phase and the key decisions, including 

the inputs, activities and products, and outputs, can be found in the Quarterly 
Progress heport, July 1, 1970 to September 30, 1970. 



F . Developing the Guidebook and the Formative Evaluation Plan 

1. The Revised Scope of Work Unit Statements was 
accepted by the Project Monitoring and Grants 
Officer. 

2. The Project Director developed a rough draft Version I 
of the specifications for each chapter of the Guidebook. 

3. The Project Director developed a plan for testing the 
Guidebook in five small rural school districts. These 
small rural schools are members of the Northeastern 
Board of Cooperative Services. The innovation to be 
implemented using the Guidebook is the Science 
Curriculum Improvement Study (SCIS) elementary science 
curriculum, and this will be a cooperative effort be- 
tween the University of Colorado, Denver Branch, the . 
Improved Learning Unit of the Colorado Department of 
Education, and Project SPREAD. 
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. The Project Director has continued the work of 

bringing greater precision to the Brief Explanation 
of Project SPREAD and the Abstract of the Project, 
which includes a Statement of the Problem, a list 
of Assumptions, and a list of Objectives. 

5. .The Project staff began the development of a docu- 
ment to be called, "The Formative Evaluation Plan 
for Project SPREAD." This formative evaluation 
plan will be tested along with the Guidebook in 
implementing the elementary science curriculum in 
the five small rural schools. 

,6. The Project staff developed a Model for the organiza- 
tional and structural arrangements to accomplish 
diffusion in the participating state agencies. Feed- 
back from the State Representatives, using the new 
feedback forms, assisted in gaining general agreement 
on the details of the Model. 

7. The Project Director began the development of training 
programs to accomplish the roles which are indicated 
in the Model. Seven training programs were envisioned 
and a rough draft of one has been developed. 

8. The Advisory Committee held its first meeting on 
October 16, 1970. The Committee agreed that its role, 
as determined by the Policy Board, was appropriate. 

The Committee will perform a quality control function 
by appraising the quality of work performed by the 
Project consultants and reporting this, in writing, to 
the Policy Board. In addition, the Advisory Committee 
will offer technical assistance to the Project staff 
and the Policy Board on the best methods to accomplish 
the Project's goalso 

9. A Policy Board meeting w as held on December 18, 1970 
to seek the commitment of an additional ten days of 
FTE resource to accomplish the development of State 
Plans. This commitment was made by the three observing 
states. To date, Wyoming, Utah, and Washington have 
committed a total of 50 FTE days each in Project SPREAD, 
while Colorado has committed 575 FTE days to the 
development of this Project. This commitment is beyond 
the time of a Project staff funded under this Project. 

10. The Project Director met with the staff of the 
Northeastern Colorado BOCS to make arrangements for the 
test of the Guidebook and the Formative Evaluation Plan. 

11. The Project Director visited with the staff of the 
National Center for the Study of Educational Change at 
the University of Indiana and with officials of the 
Southern Association of Colleges and Schools at Atlanta, 
Georgia. 

The continuing problem of the State Representatives not being funded by the 
Project, except for their travel, continues to lessen the commitment of time and 
priority that they can apply to Project matters. The result is that progress 
continues to be slower than increased funding would have permitted. 
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NOTE: A complete description of this phase and the key decisions, including the 

inputs, activities and products, and outputs, can be found in the Quarterly 
Progress Report, October 1, 1970 to December 31, 1970. 



G. Developing t he State Plans, Completing the Formative Evaluation 
P lan, Refirt i ng the Guidebook, and beginning the Test of the 
Guidebook a nd Format j vo Evaluation Plan 

1. The Project Director assisted the State 
Representatives in preparing their State Plans by 
developing a proposed Table of Contents for the 
State Plans, a Statement of Goals and Objectives 
for the Project, a list of Criteria for Cooperative 
Diffusion Strategies and Approved Variations to the 
Project Model. These activities resulted in the 
acceptance by the participating states of the format 
listed above. 

2. The Project staff completed the development of the 
Formative Evaluation Plan for Project SPREAD and the 
Plan is ready for testing with the elementary 
science curriculum adoption in the five small rural 
schools . 

3. Arrangements were completed for beginning the test 
of the Guidebook in the adoption of the elementary 
science curriculum in the five small rural schools. 

4. The Project staff completed a first draft of the 
training program for the observer's role. It will 
be tested by using the Formative Evaluation Plan 
and portions of the Guidebook in the five rural 
schools. The taped scenario of this training 
program and a set of key questions about the 
observer's role were also developed. 

5. The Project Director delayed the revision of the 
rough draft Version I of the Guidebook until the 
test of the Formative Evaluation Plan and the 
Guidebook had been completed, and it will probably 
be postponed until the operational phase of the 
Project. However, there will be considerable 
editing being made by the Project staff prior to 
the operational phase. 

6. A graduate student intern,, assigned to the Colorado 
Department of Education, was hired to perform the 
role of the observer in the test of the Guidebook 
and the Formative Evaluation Plan. He visited the 
five small rural sites, pretested students and 
teachers and observed all the training sessions 
and provided feedback to the Project staff for 
revision modification purposes. 

7. The State Representatives completed rough drafts of 
their State Plans for Utah and Washington. The 
Plans were reviewed by the Project Director who 
supplied suggestions for revisions. 
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An Advisory Committee mooting was hold on February 18. 

1971 for the purpose of appraising the quality of per- 
formance of Project consultants in the following ac- ' ' 

tivities: 

a. Instructional Systems Group, Bruce Monroe, 

Manager, who performed the "Analysis of 
the Diffusion Practices of the Colorado 
Department of Education." 

b. Dr. Garth Sorenson, U.C.L.A., Los Angelos, 

California, who developed the Formative 
Evaluation Plan for Project SPREAD. The 
Advisory Committee made a written appraisal 
report to the Policy Board on the work of 
these two consultants. 

9. A Policy Board meeting was lie 1 d at the Seattle-Tacoma 

Airport on March 23, 1971. At that meeting, the following 
was approved: 

a. Wyoming's withdrawal from the Project. 

b. The Advisory Committee report was accepted. 

c. The Utah and Washington State Plans were 
approved. 

d. Project Director directed to prepare 
proposal for an operational grant. 

10. The Project Director had a staff meeting on February 2-3, 

1971. 

11. The Project Director met with Dr. Lewis R. Crum, U.S.O.E. 

Project Monitoring Officer, on February 4, 1971 and on 
March 16, 1971. 

The only problem encountered during this phase was the forced decision to 
postpone any revision of the Guidebook until the test of the Guidebook and the 
Formative Evaluation Plan had been completed, or until the operational phase of 
the Project should begin, following funding of the proposal. 

NOTE: Detailed description and documentation of this phase and the key decisions, 

including inputs, activities and products, and outputs, can be found in the Quarterly 
Progress Report, January 1, 1971 to March 31, 1971. 



H. Developing the Operational Grant Proposal, Editing the Rough 
Draft Version of the Guidebook, and Completing the Final 
Report of the Planning Phase 

1. The Project Director prepared a proposal requesting 
a grant for an operational phase of Project SPREAD. 
This proposal requested the first year's funding 
for a five-year operational phase of the Project. 

It was submitted to the U. S. Office of Education 
on April 20, 3971. It requested multiple funding 
from The National Center for Educational 
Communication, the National Center for Educational 
Research and Development, and from the Office 
State Agency Cooperation. „ 
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of 



2 . 



Further editing was done on Version I of the 
Guidebook entitled "Cooperative Efforts to Improve 
Small Rural Schools." 

3. Members of the Project staff, the State 
Representatives, and selected members of the 
Colorado Department of Education assisted with the 
editing of the Guidebook. 

4. The Project Director prepared a final report to 
the U. S. Office of Education as directed in the 
Scope of Work Unit Statements and the grant docu- 
ments. 
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CHAPTER THREE 




A . Description of the Project Products 

During the two years of its existence, the Project SPREAD staff has 
developed the following products: 

1. A diffusion model entitled, Structural Model of 
Cooperative Efforts, by which improved school 
practices are located, selected, organized, 
carried out, tested, and self-renewal accomplished 
in small rural schools. (See Also Appendix C, 

Project SPREAD Assumptions and Diagram on page 13.) 

2. A Formative Evaluation Plan for Project SPREAD which 
is designed to guide modification of the Project's 
procedures for the purpose of immediate improvement. 

(See Appendix D, Formative Evaluation Plan for 
Project SPREAD.) 

3. A first draft version outline of a Guidebook entitled, 
"Cooperative Efforts to Improve Small Rural Schools." 

(See Appendix E, Summary Outline of Specifications for 
Chapters in the Guidebook.) 

The structural model (see diagram on following page) is a modification of 
the Havelock Linkage Perspective, modified in light of rural sociology, the par- 
ticipating states past experience in rural small school improvement projects, 
and more recent behavorial science findings. The model is the result of two 
year's study and planning by the Project SPREAD personnel in the four states. 

It depicts the roles performed by a variety of persons. One person may perform 
more than one role, while some specific roles are performed by more than one 
person. The model is really a synthesis of three smaller components: 

1. Information gathering and analysis. 

2. Diffusion management and training. 

3. Local district implementation of innovation. 

Component #1, the Information Gathering and Analysis Component, provides 
for a comparison of data produced by two information networks. The first infor- 
mation network produces small rural school data which, when analyzed, will 
divulge the needed improvements in any group of schools or in a particular 
school. In the diagram, this is role #1. Role #2 calls for the analysis of the 
information in both networks. The second information network is linked with the 
state, region, and national information centers to bring verified information 
about available improved practices. A committee will sift these improved 
practices for their appropriateness to small rural schools. In the diagram, 
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PROJECT SPREAD MODEL FOR DIFFUSION 
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THE STRUCTURE OF A COOPERATIVE EFFORT BY WHICH IMPROVED PRACTICES ARE 
LOCATED, SELECTED, ORGANIZED, CARRIED OUT, AND TESTED IN SMALL RURAL 
SCHOOLS. 
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this is role 113. Component 112, the Linkage Diffusion Component, provides for 
the multi-agency cooperative efforts, the arrangements, management, and the 
training required. It also provides linkage so that information, incentives, 
and technical assistance are provided to small rural schools who arc interested 
in adopting improved practices. The third component, Local District 
Implementation Effort, provides for the linkage of local resources with the 
multi-agency linkages and the information network. Therefore, the total re- 
sources of this throe- component network is focused upon utilizing the informa- 
tion, incentives, inventions, interactions, influence, and technical assistance 
in bringing about (through a community oriented change process) the adoption of 
improved school practices and the institutionalization of this change process 
into a self-renewing organization. 

Another way of viewing the model is to describe each of the roles in the 
diagram by their functions: 

1. Provides for the systematic gathering of information about 
local schools, (present information that is now reported 
to state and national agencies, plus). The person per- 
forming the role will collect information about administra- 
tive/instructional practices that are currently being 

used in rural schools and pass this information on to the 
person performing the analysis of school and improved 
practices. 

2. The person performing this role will analyze this informa- 
tion about small rural schools and compare it with an 
ideal model, which will be provided by the Sifting 
Committee. He also will receive, from the Sifting 
Committee, information for analysis about practices that 
are appropriate for small rural schools. He must be able 
to make comparisons of these two types of information and 
to produce a rank order list of schools that are most 

■ needful. 

3. The Sifting Committee will develop a model of an ideal 
small rural school by .gathering information from multi- 
sources. This ideal model will tell or describe an ideal 
school in relation to its practices, materials, and con- 
tent taught. The Committee will also sift the information 
on available new practices and provide it to the assessment 
analyst after determining those which are appropriate to 
small rural schools. 

4. The diffusion manager is the man to whom all others in 

the model are responsible, directly or indirectly. He will 
select an inservice training developer, but his main 
responsibility is to see to it that improved school 
practices are located, selected, organized, carried out, 
and tested. To do this, he will have to work with different 
groups of people in state agencies, private concerns, and 
local school districts. 

5. The person performing the role of field coordination will 
provide for management of the field effort in the pilot . 
schools and provide the technical assistance in the change 
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process to the school districts. He works with superin- 
tendents, principals, teachers, technical consultants of 
the various agencies, local boards of education, local 
advisory committees, and news media sources. 

6. The field liaison role is responsible for forming an 
additional partnership between the state agency and the 
local agency. It provides the avenue for the local agency to 
report to the state agency on needs for personnel adjust- 
ment in this effort. This is accomplished through monthly 
reports and interviews between the field liaison and the 
local superintendent. There is close coordination be- 
tween the field coordination and the field liaison roles. 

7. The person performing the observation and feedback role 
will observe, record, and report on all phases of the 
diffusion effort to the diffusion manager. This will 
include the training sessions and the local implementation 
effort . 

8. Inservice development. This is the person that will see 
that training is given to all those people on this 
diagram, to see that the training is effective, and to 
see that the training and training materials are changed 
as needed. 

9. Technical assistance from other agencies and state cduca- 
and tional agency technical assistance are a pool of people 

10. with specialized technical assistance expertise in the 

multitude of innovations to be adopted. Some will have 
expertise in more than one specific innovation, others 
will have expertise in, for example, reading, nongraded 
organizations, and early childhood education. 

Roles 11 through 15 are roles provided by the local research, development, 
and diffusion community-oriented change team. They are commonly thought of as 
the local superintendent of schools, the principal, the school board, the 
teachers, the students, the lay advisory committees, and others concerned with 
the local improvement effort. Eventually, all of the roles, 1 through 10, will 
be shifted to the local school district, and local people will be trained to 
perform these roles. When local people are adequately performing these roles, 
the local district will then have achieved an operational definition of the 
self-renewing organization. 

The Formative Evaluation is not unlike the idea of quality control in 
industry. Simply stated, it is the idea that part of the effort and resources 
ordinarily expended in developing and using any improved program should be 
devoted to testing out and improving these programs, particularly, during the 
course of their development, in order to make certain the program will, in fact, 
work, or is, in fact, working with a particular group of students. This con- 
cept of evaluation for course improvement, project improvement, or program 
improve menx began with the work by Cronbach (1963), Formative Evaluation by 
Scriven (1967), and "Operations Research" by others. In the past, programs 
have often been tested to see if, in fact, they do work. But the notion of 
improving a program as it is being developed is even more important than- the 



notion of testing it. Sophisticated program developers do not expect a program 
to work well the first time it is tried; so, as developers, they see it as part 
of their task to take steps to find out why it is not working. They change it, 
try it again, and continue the process until the program becomes effective for 
those for whom it is intended. Fundamental to this formative evaluation approach 
is a set of assumptions: 

1. Any program should be expected to bring about measurable 
changes in the students, and that if the program fails 
to produce these changes, there is something wrong with 
the program. 

2. Instructional programs should be repeatable and reliably 
taught . 

3. Instructional programs should be pretested. 

4. Any given program will work more effectively with some 
students than with others; a formative evaluation plan 
should be designed to obtain information about the 
characteristics of the students, and, especially, about 
the characteristics of those students who do not learn 
from the program. 

5. Formative evaluation requires a particular array of 
roles, skills, and tools which have not traditionally 
been employed in developing programs. In developing an 
(instructional) program, it is obvious that questions re- 
garding the "content-validity" of the programs be answered . 

Soma of the technical questions which must be answered in- 
clude : 

a. What could go wrong during the instructional 
process? At what point in the program is 
failure most likely to occur? 

b. Who is in a position, or can be placed in a 
position, to pick up and feed back clues as 
to the nature of that failure, if it does 
occur? 

c. What procedures are needed systematically to 
obtain information from observers about the 
nature of the difficulties encountered by the 
users in learning and applying the program, 
and by the studer.es in learning what the 
program intends for them to learn? 

If these questions are to be answered, the formative evaluation approach has 
to take into account consideration like these listed below in setting up a pro- 
gram development plan: 

1. The users must be trained. Therefore, someone needs 
to perform the trainer role. 

2. During the tryout cycle, the useres should be monitored 
to set if they are, in fact, using each component as 
planned. Therefore, someone on the program development 
team must prepare schedules and perform the monitor 
role. 



3. Student?' must be protested and post- tested. There- 
fore, someone must choose or bu:i Id instruments and 
administer them - this is the evaluator role?. 

A. The trainer, the users, the monitor, the evaluator, 
and. the students should be asked routinely and 
systematically to note where difficulties occur and 
should he invited to suggest possible solutions to 
those difficulties. Therefore, someone must be 
assigned the task of asking questions and recording 
answers. Someone, perhaps the development team as 
whole, will need to review those answers and make 
revisions in the program accordingly. 

The above general comments about formative evaluation provide the basis 
upon which the Formative Evaluation Plan for Project SPREAD was dcvc?loped. The 
purpose of SPREAD is to develop and partially test a set of procedures (plan or 
model) which, if adopted, will enable small rural schools of Colorado, Utah, 
and Washington to evaluate and improve their operations continuously. To do 
this, two types of information will be gathered and transmitted: 

1. Information related to needed school practices in 
those states and in other parts of the country. 

2. Information relating to how well the diffusion 
organization is operating and what needs to be 
done to make it operate better. (A complete 
description of the Formative Evaluation Plan for 
Project SPREAD can be found in Appendix D of this 
report. ) 

The Project SPREAD procedures (model or plan) has been described and, to a 
large extent, operationally defined in a collection of documents called a 
Guidebook. The Guidebook is entitled, "Cooperative Efforts to Improve Small 
Rural Schools," The Guidebook will: 

1. Present the rationale .for the cooperative diffusion 
effort, the sources of that rationale, related 
studies, belay misconceptions, answer general questions, 
etc . 

2. Specify the activities, procedures, or operations to be 
performed by persons or groups performing each of the 
roles in the cooperative effort, including those 
persons whose task it will be to make the effort in- 
creasing effective. 

3. Include a number of "training packages," one for each 
role in the organization. 

4. Describe the "formative evaluation" or "corrective 
feedback" procedures for: 

a. Checking on and improving the success and 
efficiency of each o£ the persons or groups 
occupying each of the role positions, thereby 
gradually improving the effectiveness of the 
cooperative effort as a whole. 



23 



- 17 - 



b. 



Make the Guidebook Inteligible to general 
readerr. . 

j c. Periodically revise the SPREAD Project 

itself. 

Jn brief, the strategy is as follows: Each of the above, e.g., each 

training package; will be written in preliminary form, then tried in the field, 
then evaluated, then revised, and the cycle will be repeated until it has been 
demonstrated that a given portion of the Guidebook is effective with members of 
the cooperative effort for whom it was designed. Beyond that point, revisions 
will continue to be made, but less frequently. (See Appendix E, Summary Outline 
of Specifications for Chapters in the Guidebook.) 

u • e stimat ed R e source req uiremen ts fof; spreadin g t he progr am to the, other 
p articip ating s tate "dep artments' op education .. " 

The Project SPREAD Model developed during the planning grant has not been 
demonstrated in any state department of education. In order to spread it to the 
state departments of education in Colorado, Utah, and Washington, the following 
job categories need to be implemented: 

1. One project director 

2. One assistant director 

3. A diffusion manager in each of the throe states 

4. A field coordinator in each of the three states 

5. One inservice training developer 

6. An observer in each of the three states 

7. A local information data processor in each of the three states 

8. An improved practices retrieval specialist in each of the 
three states 

9. A needs analyst in each of the three states 

10. One sifting manager 

In addition, there are eight categories of contracted services, including: 

1. An Information Retrieval Center Services 

2. An independent auditor 

3. A formative evaluator 

4. Sifting consultants 

5. Training consultants 

6. Advisory Committee members 

7. Improved practices technical assistance consultants 

8. Planning and management consultants 

A budget breakdown for the implementation of these ten job categories and 
eight contracted services can be found on the following pages. The total Project 
cost c or one year includes a 20 percent indirect cost, but does not include ap- 
proximately $450,000 of matching in-kind costs contributed by the states. The 
in-kind costs consist mainly of a contribution of staff members for technical 
assistance to implement Project SPREAD’S efforts in a total of twelve school 
districts in the first year in the three states. 
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PROJECT SPREAD 
BUDGET BREAKDOWN 
JULY 1, 1971 - JUNE 30, 1972 



w DIRECT COSTS 

;Jf personnel Salaries 
a. Central Staff : 



Project Director 
Assistant Project Director 
Sifting Manager 
In service Coordinator 
Secretaries 



FTE R ate 

1 $.19,’ 200.00 
1 17,000.00 
1 10 , 000.00 
1 15,000.00 
3 19,0 00.00 



Total Central Staff 



$ 85,200.00 



b. State Staffs: 

Diffusion Managers 
Field Coordinators 
Local Information 
Data Processor 
Need Analysts 
Improved Practices 
Retrieval Specialist 
Observer 
Secretaries 

Total State Staffs 



Colorado Utah 



FTE 


Rate 


FTH 


Rate 


1 


$18,000 


-- 


— 


1 


15,000 


i 


16,000 


1/3 


4,000 


1/3 


4,000 


1/2 


8,000 


1/2 


6,000 


1/2 


8 , 000 


1/2 


8 , 000 


1 


10 , 000 


1 


10,000 


3 


16,000 


3 


16,500 



Washington Totals 



FTE 


Rate 


FTE 


Rate 


1 


$18^650 


2 ~ 


$36,65*0 


1 


15,750 


3 


46,750 


1/3 


4,000 


1 


12,000 


1/2 


. 8,875 


i£ 


22,875 


1/2 


8,375 




24,375 


1 


10,000 


3 


30,000 


3 


14,400 


3 


46,900 



219,550.00 



c. Contracted Services Salaries: 
(l) Central Staff 

Independent Auditor 
Evaluator 

Sifting Consultant 
Planning Consultants 
Training Consultants 
Advisory Committee 

Total 



$ 9 , 000.00 
12 , 000.00 

15.000. 00 

10.000. 00 
9 , 000.00 
4,000.00 



(2) State Contracted Services: „ , , .... _ , . 

Colorado Utah Washington Total 

Information Center $ $ $ $ 

Services and Technical 

Assistance Consultants 20,000.00 20,000.00 20,000.00 $60,000.00 

Local Site Consultants 10,000.00 9,000.00 46,400.00 65,400.00 

Outside Local Evaluation 

Teams 8,850.00 8,850.00 



59,000.00 



Total 



134,250.00 



Grand Total Personnel Salaries (51) 



$498,000.00 
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2. Employee Benefits (Rate 10#) 

Central Staff Total Salaries $80,200.00 x 30# 
^ Colorado Staff- Total Salaries $79,000.00 x 30! 
P Utah Staff-Total Salaries $60,500.00 x 10# 
Washington Staff-Total Salaries $80,050 x 10# 



Total Employee Benefits (charged os direct) (52) 



$ 8,520.00 

7.900.00 

6.050.00 

8.005.0 0 

( $30,4 75.00) $ i 30 .500.00 



3. 



Travel- ( State per diem varies, but $20.00 Is the average. The amount 
budgeted per position is based on past experience in similar multi- 
state projects.) 

a. Central Staff-Travel: 

„ Project Director 
Assistant Project Director 
Sifting Manager 
Inservice Coordinator 



Total 



State Staf f s-Travel ' 

Diffusion Managers 
Field Coordinator 
Local Information Data 
Processors 
Needs Analysts 

Improved Practices Retrieval 
Specialist 
Observers 

Total by State 

Contracted Services-Travel : 

(l) Central Staff 

Independent Auditor 
Evaluator 

Sifting Consultants 
Planning Consultants 
Training Consultants 
Advisory Committee 

Total 



Colorado 


Utah 


Wash. 


$ 7,000.00 

3.000. 00 

2.000. 00 
2,000.00 

Total by 
Positi on 


$ 14,000.00 


$1,500 


$1,500 


$1,500 


$ 4,500.00 




4,000 


3,000 


4,000 


11,000.00 


* 


150 




150 


300.00 




800 


800 


800 


2,400.00 




1 . 

250 


250 


200 


700.00 




2,000 


2,000 


2,000 


6,000.00 




$8,700 


$7,550 


$8,650 




24,900.00 




(Contract includes travel) 





$ 3,600.00 
6 , 000.00 
3 , 000.00 

4.000. 00 

2.000. 0 0 



18,600.00 
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Total 

Total Travel (53) 






State Contracted Services 


Colorado 


Utah 


Wash. 


Totals 


Technical Assistance 
Consultants 


$7,000 


$7,000 


$7,000 


$21,000.00 


Local Site Consultants 


3,500 


3,000 


— 


6,500.00 


Outside Local Evaluation 
Teams 










Local Visitation Teams 


4,000 


4,000 


4,000 


12,000.00 



39.500.00 



$ 97.0C0.C9 



4. 

t 


Supplies and Motor! nls 
Control Staff 
Co lorado 
Utah 

Wash! ngton 






$ 4,000.00 
3,500.00 
3,500.00 
4,000.00 






Total Supplies and Materials (54) 








$ 15,000.00 


5. 


Co mnriu r d cations 
Central Staff 
Colorado 
Utah 

Washington 






$ 2,500.00 
2,500.00 
2,500.00 
2,500.00 






Total Communications (55) 








$ 10,000.00 


6. 


Servi cos 












a. Duplicating and Reproduction: (56) 
Control Staff 
Colorado 
Utah 

Washi ngton 




$7,000.00 

4,500.00 

4,000.00 

4,500.00 


$20,000.00 






b. Statistical: (57) 
Central Staff 
Colorado 
Utah 

Washington 




$1 ,550.00 
150.00 
150.00 
150.00 


2,000.00 






c. Testing: (58) 

Central Staff 

Colorado 

Utah 

Washington 




$ 

650.00 

650.00 

700.00 


2,000.00 






Total Services 








$ 24.000.00 


7. 


Other 

Graphics 

Contingency 






$ 5,000.00 
20,000.00 






Total-Other (59) 








$ 25,000.00 


8. 


Equipment 

Terminals - two each state @ $4,000.00 
Pocket Tape Recorders - 50 @ $60.00 
Typewriters - 12 @ $500.00 
Transcribers - four @ $500.00 
Equipment to support Innovation ($1,000 
One-half inch V.T.R. Unit for Training 
teaching, etc.) 


per 12 sites) 
Programs (Micro- 




$24,000.00 

3.000. 00 

6.000. 00 
2,000.00 

12,000.00 

3,000.00 




s 


Total Equipment (61) 








$ 50.000.00 
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$749,500.00 
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Subtotal-Direct Coats (carried forward) 



$749,500.00 



B. ^DIRECT COSTS - [20%) 

Note: Tbo State of Colorado is currently preparing an indirect coot 

proposal to the Federal Government. The indicated rate will 
be 20 percent. This anticipated proposal for an indirect cost 

rate is to be submitted prior to June 30, 1971. $149 .900.00 

C. TOTAL COSTS (Federal Support) $899.400.00 
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CHAPTER POUR 



I • FIN DINGS AND R PC OMME ND AT 1 C N S 

Project SPREAD spent tv.’o years in a planning phase with only a brief 
operational test of portions of the Model, Guidebook, and Formative Evaluation 
Plan. Because of this, it is difficult to support, the findings of this Project 
with sufficient data. However, the findings do represent the best thinking of 
the Policy Board, the Project staff, including the State Representatives, the 
Project's external consultants, the Advisory Committee, and various members of 
the staff of the Colorado Department of Education who participated in the 
Project. All of these people, interacting with each other, trying out and 
testing ideas and concepts, seeking the reactions of other experts, reviewing 
the literature and research findings, and evaluating and revising their position 
have resulted in a set of findings that is supported by the vast majority of the 
people who have participated in the Project. 

The findings of Project SPREAD are as follows: 

1. State educational agencies are in a unique pivotal position to 
provide the diffusion linkage between small rural schools and 
all other agencies. Intermediate units or Boards of 
Cooperative Services are also in this unique linkage position. 
Regional Laboratories, Research and Development Centers, in- 
stitutions of higher education, and other governmental 
agencies do not share this same unique diffusion position, but 
they do occupy an equally important position in research and 
development. State agencies and Boards of Cooperative Services 
are in this unique position for the following reasons: 

a. The state agencies who concentrate on the leadership 
and service role, as opposed to the regulatory role, 
have already established a helping diffusion re- 
lationship which can be capitalized on and improved. 

b. There is already an administrative relationship and 
responsibility between small rural schools and their 
state educational agencies which places both of 
them in partnership roles in cooperative efforts. 

c. Personnel in state educational agencies know the 
norms of the small rural school client systems, 
speak their language, and identify with their needs 
and aspirations to a greater degree than do person- 
nel from other agencies. 

d. Practioners in small rural schools are more willing 
and better able to request cooperative effort 
services in developing improved practices from 
state educational agencies than from other agencies.. 



e. When small rural school districts choose to "go 
it alone" in developing improved practices, they 
still are anxious to have the backing of their 
state educational agency. Whereas, in these in- 
stances, the backing of other agencies is seldom 
requested . 

2. Small rural schools have many weaknesses, but one of their 
strengths is that they can be an easily managed laboratory 
site, simply from the standpoint of logistics and the ease 
with which new practices may be installed. Long-term 
planning and phase-out efforts are usually not required in 
small schools because of their built-in flexibility. 

3. The Formative Evaluation Plan for Project SPREAD, used in 
the elementary science curriculum inservice field tost, 
worked well in providing data on which to base modification 
decisions about the Model, the Guidebook, and the Formative 
Evaluation Plan. 

4. Everyone involved in a cooperative improvement effort requires 
training in order to perform their designated roles, even 
though they may have some previous experience in performing 
similar roles. The types of training required in rank order 
are : 

a. Theory and application of behavioral science 

b. Theory and application of organizational development 

c. Theory and application of knowledge utilization 

d. Theory and application of community oriented change 
process 

5. Small rural schools can become much more effective in providing 
a quality education for all students through cooperative im- 
provement efforts involving small rural schools, state educa- 
tional agencies, and other agencies. Thus, there is an 
alternative to school district reorganization, namely, compre- 
hensive cooperative improvement efforts. 

The recommendations of Project SPREAD are as follows: 

1. The Project SPREAD diffusion Model, the Guidebook entitled, 
"Cooperative Efforts to Improve Small Rural Schools," the 
Formative Evaluation Plan, and all the various diffusion 
procedures and strategies need to be tested in an operational 
setting over a long period of time, until all can be made to 
reliably work. 

A proposal to accomplish this was submitted to the U. S. 

Office of Education, but, unfortunately, was not funded. 
However, the commitment of the three participating states 
(Colorado, Utah, and Washington) is so strong that each 
state intends to carry out some of the activities proposed 
in that proposal on a minimal funding basis within their own 
states, and, hopefully, to continue to share the results of 



these efforts with each other on an informal basis. At 
a later date, these states will again submit a revised 
version of the Project SPREAD proposal to the U. S. 
Commissioner of Education. A proposal will not only be 
revised, but will be enlarged to include the establishment 
of diffusion strategies and models for schools of all 
sixes. These three states are so strongly committed to 
the concept that diffusion of improved practices is so 
central to their operation and so necessary to the improve- 
ment of schools within their states that they will continue 
to work cooperatively and continue to seek funding for the 
support of the accomplishment of this end. 
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APPENDIX A 

SCOPE OF WORK UNIT STATEMENTS 
for the 

Four-State Diffusion Project SPREAD 



G5C 

Pv 



The contractor will complete the 
work unit will serve as a major 
ect toward the improvement of the 
ici noting state departments of od 



Washington) : 



Scope of 'Work Units. The completion of 
evaluation milestone for advancing the 
diffusion function in each of the four 
ucation (Colorado, Utah, Wyoming, end 



1 * CREATING THE PROJECT 

A. Create a Policy Board composed of tho chief state school 
officers of the participating states to provide guidance 
and. direction to .the Project. 

B. Describe the objectives and functions of tho Policy Board. 

C. Determine the By-laws and operating policies. 

D. Specify the operational phase formative evaluation mechanism, 
and test it in the pilot phase. 

E. Create an Advisory Committee at the state level and determine 
its composition and function. 

F. Select a full-time Project Director who has had successful 
experience in planning and implementing diffusion strategies. 

G. Select a field director who has had successful experience 
working with rural small schools and has a knowledge of dif- 
fusion strategies. 

H. Appoint representatives as observers and technical advisors 
from each participating state department of education to 
work with the Project Director to develop a formalized plan 
for the establishment of the diffusion function in their 
respective states. They will observe Colorado's activities 
and assess the appropriateness of these activities as a 
basis upon which to devoloo a plan for the diffusion function 
in their respective states. These representatives should be 
full-time employees in the respective state departments of 
education who probably will be assigned to direct the improve- 
ment of the diffusion function in their respective state 
departments of education. 



II. PLANNING THE PROJECT 



A. Analyze the strengths and weaknesses of diffusion practices 
in the Colorado Department of Education. Emphasis will be 



i 




placed on the functions and authority (with respect to dif 
fusion) of the various types of personnel. In addition, 
the impact of the Department's diffusion efforts and the 
communication between the state and the pilot schools will 
be stressed. Estimates of the operating costs involved in 
diffusion will be made. 



III. 



OP HP 



i-./ii 



TON’ Or THE 



PROJECT 



A. 



Analyze and describe the organizational and structural ar- 



rangements needed to activate and msi ntain. the state diffu- 
sion function and local, diffusion efforts. This description 
will stress the major decisions reached and the process and 
procedures followed. The resources allocated will also be 
described. The description will include the criteria that 
were used to select the cooperative diffusion procedures 



for utilization in Project SPREAD. 



B. Develop a guidebook from the "analysis activities" listed in 
IT. A. and III. A. The guidebook will contain a related 
series of training programs and evaluation packages. 

C. Analyze selected rural small schools to determine their 
uniqueness in regard to diffusion and determine what changes 
the application of the cooperative diffusion procedures, as 
contained in the guidebook, such uniqueness mandates. 

D. Describe and document the selection of appropriate practices 
for testing diffusion strategies (cooperative diffusion pro- 
cedures) in rural small schools. Emphasis will be placed on 
the criterion used to select appropriate practices and the 
performance specifications to be met during the tryout period 
in the selected pilot schools. 

E. Describe and document the training of appropriate state de- 
partment of education personnel to carry out the cooperative 
diffusion procedures, using the LEA selected educational 
practices. Stress should be placed on inservice training for 
specific tasks to be accomplished by each participant in the 
total diffusion strategy. 

F. Describe and document the training of appropriate rural small 
school personnel to implement the cooperative diffusion pro- 
cedures and to utilize the LEA selected educational practices. 

G. Describe and document the procedures used to provide feedback 
on the effectiveness of the cooperative diffusion procedures 

- at the receiver--school level to the diffusion function in 
.the stale department of education. Emphasis will be placed on 
describing of mechanisms used in reporting the Project's 
cooperative efforts and the self- corrective measures employed 
to keep the cooperative diffusion procedures on target. 
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IV. REPORTING THE PROJECT 



A. State representatives will provide written feedback to the 
Project Director as they monitor the work units described 
in this document. This written feedback will be submitted 
upon the completion of each major work unit designated by 
the Project Director, and it will stress the relevancy of 
the activities completed to their respective states. 

B. At least three months prior to the end of the initial grant, 
each state representative will prepare a plan for recommencing 
to the chief state school officer of his state the development 
of the diffusion function in ills respective state department 
of education. These plans will stress the diffusion need, the 
existing diffusion potential, the function, the authority, the 
organizational and structural changes required in the state de- 
partment of education, the alternative cooperative diffusion 
procedures available, the criteria to be used in selecting the 
cooperative diffusion procedures, the training requirements 
needed at local and state levels, the reporting procedures 
needed to accomplish feedback, and the operating costs involved. 

C. The Project Director will provide quarterly progress reports 
on accomplishments, problems encountered, posed solutions, and 
work to be accomplished over the ensuing quarter, and a final 
report that describes and documents the key phases of the pro- 
gram, key decisions that v.'ere made, inputs, activities ana 
products, ana outputs for each phase, and estimated resource 
requirements for spreading the program to the other partici- 
pating state departments of education. 
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NOTfCE 

The information in this document contains the principle findings and recom- 
mendations of a study of the Colorado Department of Education's dissemi- 
nation and diffusion efforts for the school year 1909-70. The study was 
intensive but not exhaustive because of time and budgetary limitations. 
Certain of the findings, if taken out of context, would present an inaccurate 
picture of the total diffusici. activities of the Colorado Department of Edu- 
cation. 
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(The following text was produced by Project SPREAD stuff for the Colorado 
Stale Board of Education. It is provided as background to this study and as 
an illustration of the Department of Education's commitment to improve the 
small rural school. ) 



R os o' 1 ution in S u pport of the F c mr-r tate Di f fusion Pro j oct 

1. In the past the Colorado State Board of Education has been seeking ways 
and means to improve the quality of educational programs in small rural 
schools, and during this period the. Board has joined with certain local 
school districts in demonstrating and documenting these ways and means. 

2. The implicit philosophy of such a partnership has always been that there 
is a need to find methods of developing more relevant and comprehensible 
learning oppoi (.unities in small schools. 

3. The Colorado Department of Education was the initiating body of a proposal 
to the United States Office of Education, Bureau of Research, entitled 
Project SPREAD, State Programs Revitalizing Education and Diffusion. 

The State Departments of Education of Utah, Washington, and Wyoming- 
joined in this proposal. The initial planning grant phase of this Project 
was funded by the U. S. O.E . on June 25, 1.9G9. 

4. The Project proposes to define, document, and field test the alternative 
roles of the State Education Agency in accelerating the diffusion of promising 
educational practices to small rural schools as a means of improving edu- 
cational opportunity for youth in these schools. 

5. The Colorado State Board of Education plans to acquire the cooperation of 
the appropriate members of the staff of the Colorado Department of Edu- 
cation and of the certain teacher education institutions of the State in 
carrying out the Project. 

6. The Colorado State Board of Education plans to give assurance to the Project 
schools that accreditation requirements will not restrict the experimentation 
and research needed to successfully complete the Project under the following 
specified conditions: 

a. Local districts must exhibit proper planning. 

b. Those who are affected by the Project should be involved in the 
planning. 

c. There will be built-in assessment and evaluation procedures so that 
those participating do not perpetuate mistakes. The Board will 
continue to diffuse the positive findings of the Project geographically. 

7. The Colorado State Board of Education considers itself morally and in fact, 
legally responsible for maintaining and, wherever possible, improving 
established standards of instruction; therefore, the staff of the Colorado 
Department of Education will be further charged with the responsibility for 
scrutinizing this Project for the purpose of maintaining an essential system 
of checks and balances. 



8. The Colorado Stale Board of Education intends to remain in close contact 
with the operation and findings of the Four-State Diffusion Project SPREAD 
and, in fact, fully understands and accepts the responsibility for its 
operation in Colorado. 

9. The Colorado State Board of Education, having been fully apprised of the 
philosophy and intentions of the proposal for the Four- Stale Diffusion 
Project and of Colorado's specific part in this program, welcomes the 
opportunity afforded for the continued exploration and continued leadership 
which Colorado has exerted on behalf of the improvement of small rural 
schools. 

"BE IT THEREFORE RESOLVED, that the Colorado State 
Board of Education gives strong endorsement and support 
to the Four-State Diffusion Project SPREAD and agrees to 
waive accreditation requirement under specified conditions 
to encourage experimentation in the Project schools. This 
Resolution is adopted on the 10th day of February 1970, and 
has been entered into the Minutes of the Board. " 



Assumptions About Schools, Innovation and Diffusion 

(Adopted by Project SPREAD from drafts by Dr. Garth Sorenson, Project 

Evaluator, and modified in discussions with C.D.E. staff and other State 

observers. ) 

1. The schools are not as effective as they could be. They are not doing as 
good a job as might be expected in teaching children to read, to understand 
mathematics, etc. To admit this is not to imply that teachers and other 
school personnel are anything other than hard working, conscientious, and 
dedicated, but merely to recognize that for a variety of reasons most school 
people have been so busy just keeping the system going that they have not 
been able to devote the time and resources needed systematically and 
continuously to improve instructional procedures, administrative arrangements, 
counseling methods, etc. 

2. It is possible to improve the effectiveness of the schools. A number of 
promising innovations have been developed in educational laboi'atories, 

Research and Development Centers, universities, and in the schools them- 
selves. Mechanisms for identifying crucial weaknesses in particular 
schools and for replacing ineffective practices with newer ones which are 
demonstrably more effective, (and which are feasible within the resources 
available to a school) are also needed. 

3. Innovation must be a continuous process in education. Because the needs 
of students and the community change, instructional procedures and ad- 
ministrative arrangements can never be perfected once and for all, but 
must be subject to continuous or at least periodic appraisal and revision. 
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4 . Innovation is not an nnd in itself. It is rather a means to achieving more 
effective instruction, the goal being: increased learning on tho part of 
students. The process and role of innovation should be continuous and 
not related to any single effort to diffuse a given practice. 

5. The ultimate purpose of the SPREAD Project is not to determine nor to 
change the educational objectives of a particular school, i.e. , what the 
students learn — although it may bo desirable to change the way those 
objectives arc stated- -but to make instruction more effective. Though 
educators may have opinions about desirable goals and may choose to 
attempt to influence community views, it is a practical fact— as well as 
a values proposition — that responsibility for determining tbo goals of the 
schools resides with the citizens of the community. 

6. The specific task of the SPREAD Project is to eventually tost the relative 
effectiveness of various intervention (diffusion) strategics to the end of 
contributing to the general knowledge about how to diffuse useful innovations. 

7. The C.D.E.ks innovative role should be a continuing one, not coterminous 
with any particular project. 

8. The C.D.E. should be concerned with a variety of innovations, the particular 
innovation to be introduced into any school or district to be determined by 
the needs of that school or district. (A need may be said to exist when a 
particular educational goal is not being achieved.) 

9. No educator or educational organization existing today is using replicable 
procedures that will reliably work and cause improved school practice. 

10. Diffusion efforts typically do not succeed as planned, however a diffusion 
effort can be made to eventually succeed, through a gradual process of 
successive approximation of the ultimate objective, guided by "corrective 
feedback" used as formative evaluation evidence to reshape the effort at 
several points in time over a process of months and years. 

11. A written set of replicable procedures (that describe sets of specialized 
rules to modify sets of generalized rules) can be produced that will 
eventually insure diffusion of a given improved school practice into a 
given school setting. These procedures can be documented over a period 
of years as they become evident through a series of tryout/revision cycles 
in which reliable procedures are continued and refined and unreliable 
procedures are modified or abandoned. 



AN ANALYSIS OF 
DIFFUSION PRACTICES £N THE 
COLORADO DEPARTMENT OE EDUCATION 



PURPOSE 

Project SPREAD'S Sr; one of W o rk-Unit Stat em ents E ami F specify the following: 



"E, Analyze the strengths and weaknesses of diffusion practices in the 
Colorado Department of Education. . 

"F. Analyze and describe the organizational and structural arrangements 
needed to activate and maintain the diffusion function. . . " 



This report, combined with the proposed models and procedures furnished by 
Project SPREAD staff is intended to fulfill these requirements. The findings 
reported herein, arc those which were considered to be of benefit to each of 
Project SPREAD'S participant states since this report is but the first stop in 
a complex program to develop workable models that insure systematic im- 
provements that reach the learners in small rural schools. 



The purpose of this analysis is formative in nature, that is, the information 
gleaned from the analysis reported in this document is to be used to further 
strengthen the diffusion function and organize a dissemination and diffusion 
unit within the Colorado Department of Education and eventually in the cooper- 
ating states of Utah, Washington, and Wyoming. An intensive analysis of 
dissemination and diffusion has also been carried on by the Department Task 
Force formed in October, 1969 and currently concluding its own analysis. 

Over one hundred sixty-five man/ days have been devoted to that effort to 
date. A final report of that study will be issued in late April, 1970 and should 
be read in parallel with this report. 

Potential misunderstanding of the distinction between dissemination (not ex- 
plicitly covered in this report) and diffusion (the function of the C.D.E. 
analyzed in this report) can be avoided by referring to the following definitions. 



INNO VA TION , a new or different concept, methodology, organization, 
or program tliat is systematically introduced into the classroom, school 
system, and/or (lie. Stale. For the purpose of this study, an innovation 
was defined as a program perceived as new by the individual. 



D1 SSF ?\i T NAT1 O N, the process of giving and receiving information about 
the operation and outcome of an educational activity in such a in miner 
as to create an awareness, interest, and conviction regarding' the value 
of Die activity. 



DIF F t -hi ON, the process involving information consumption, social 
interaction, and behavioral change through which an innovation is incorpo- 
rated into an individual, a group, or a. system. The diffusion process 
includes Die nine sub-processes of: dissemination, demonstration, 
implementation, invention, adoption, adoption modification, evaluation, 
institutionalization and sustaining support. Dissemination is spreading 
the word; diffusion is spreading the practic e. 



PROCEDURES 

Two basic procedures were used to conduct this study. The first of these was 
a comparative analysis of responses to structured interview questions made 
by C.D.E. personnel and rural school practitioners. 



The second procedure was to gather and analyze any information that described 
or implied a procedural model of a diffusion practice being carried out by 
C.D.E. personnel or being carried out in cooperation with other agencies. 

This was accomplished through interviews with key C.D.E. leadership staff 
and textual analysis of over 100 documents. 

The data collection was conducted in three phases by an ''information-gathering 
team 11 composed of seven C.D.E. personnel (who interviewed within the De- 
partment) and fifteen small rural district personnel (who interviewed the 
school practitioner group), hi the first phase, a stratified random sample 
of 25% of a list of 124 board members, administrators and known innovative 
teachers from six, small rural school districts (selected at random as re- 
presentative of those in the state) were asked ten questions pertinent to recent 
changes in school practices that may have been influenced by C.D.E. diffusion 
efforts. In addition, eleven questions were asked of 40 C.D.E. personnel 
selected at random. (See Appendix, Lists I- A and I-B for actual questions. A 
listing of interviewers may also be found in the Appendix. ) The questions for 
the second phase of interview's were structured on a basis of the information 
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yielded by the first sets. In this cycle, 35% of the original total C.D.E. staff 
were interviewed mere intensively while the majority of the same rural school 
population was again questioned in greater de tail. (See Lists TI-A and 3 1—33 in 
Appendix. ) 

The third and final round of questions were made to eight selected C.D.E. 
personnel. The field interviewers were also interviewed by telephone in an 
attempt to gather any unrecorded or newly uncovered information. (See List 
III— A in Appendix. ) 

All of the inputs from these phases as well as the gathered documentation 
were then analyzed and cross-checked for validity and eonsistaney. 



Because the emphasis in the SPREAD project is on the analysis of diffusion 
into sma’l rural schools only, a very small sample of all of the school districts 
of the State of Colorado wore studied. It is estimated that the responses made 
by the practitioners in the schools represent approximately 6% of the schools 
of the state with those schools enrolling; less than 10% of the total school 
population of the state. 

A second factor which should be kept in mind while interpreting the findings 
is the established C.D.E. practice of building local leadership so that change 
is initiated by local leaders of (he schools rather than playing a direct and 
active role in the change process. To the extent that this practice of building 
local leadership has been effective, the majority of the changes should pre- 
dictably occur due to local leadership. This is substantially borne out in the 
findings. 



FINDINGS 

No summary can begin to be as valuable as the detailed study of actual re- 
sponses to questionnaires and interviews. The reader is encouraged to pursue 
certain findings in greater detail in the records of Project SPREAD, where 
the original documents have been forwarded, as well as in the summaries of 
results found in the Appendix. 
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This sect i <■.';! will be sub-divided into six categories as follows: 

I. General Findings 

II. Innovation in Colorado 
ITL Oiyemmmg foi’ Diffusion 

IV. Popular Diffusion Activities 

V. Perceptions of Cost 

VI. Porooplions of Effectiveness 

I. General Finding's 

The C.D.E. has a well-documented record of accomplishment in diffusing 

improved school practices into small rural school districts, schools and 

classrooms. The two fundamental questions asked in this analysis were; 

o Can the diffusion procedures now in use be further refined so as to « 

improve the reliability with which an improved practice is diffused ? 

9 Can the cost-effectiveness ratio of present C.D.E. diffusion practices ; 

be improved? 

This analysis has clearly indicated that both questions may be answered in 
the positive. 

Based upon their experience with over half of the nation's departments of 
education, 1NSGROUP consultants rank the Colorado State Department of Edu- 
cation among the top six to ten such departments. Questions directed to pro- 
fessional staff in other state departments of education support this conclusion. 

Based on the number of students to be served in the districts of the state, the 
C.D.E. is understaffed when compared with other state departments of edu- 
cation. Considering this understaffed condition, the accomplishments of the 
Department are commendable. 

As recently as May, 1969, a U.S.O.E. site-visit review team concluded that, 
as a whole, "C.D.E. services to local school districts are outstanding." A 
Department- conducted survey of 1963 indicates that the C.D.E. has a record 
of success in diffusion that extends back many years. 


*rv 

\ 


Seven relatively distinct diffusion practices were identified during this analysis. 
Although one may be regarded as leading into or overlapping another under 
certain circumstances, the following models were isolated for purposes of 
study and reporting. 
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A. 



A. EnrUmspinont k If j 'll • The C.D.E. convinces ilm Local EducuticHml. 

Agency (LEA) Superintendent to oiiclor.so cerium practices by providing 
him rational evidence and supporting his visits to other LEA's as an 
observer. 

(Example: D. E. F. ) 

]3, Targ et! od Comm uni mi ll on M odel: The C.D.K. learns of a general 

interest or felt need for a particular innovative practice; responds with 
a carefully prepared and timed communique relative to tljat practice 
then responds to any request for service generated by the communique. 
This is primarily a dissemination model. 

(Example: C.D.E. Publications) 

C. Lig hthous e Mo del: The C.D.E. forms and supports a network of schools 
which have proven or potential capability for successfully implementing; 
innovations; disseminates results and lcmls heavy support to those seek 
to follow example: e. g. , seeks exemptions. 

(Example: W. S. S. S. P. , BOCES) 

D. Legislative Model: The C.D.E. helps to shape and get passed mandatory 
and enabling legislation which encourages innovation; then assists in 
proposal development for response to legislation by LEA. 

(Example: Title HI, Budget Form) 

E. Accountabili ty M odel: The C.D.E. assists the LEA in establishing 
performance objectives for accountability, then follows up with assistance 
in conducting formative evaluation for program development revisions. 
(Example: Contract Accreditation, Program Planning and Budgeting) 

F. In-se rv ice. Trai nin’; - Model: This practice emphasizes the cooperative 
pre-service and in-service training efforts of Hie C.D.E., Higher Edu- 
cation Agencies, Research and Development Laboratories and Foun- 
dations. It relies, to a great extent, upon the "ripple" effect of atrained 
person passing on his knowledge and perceptions to others. 

(Examples: D. U. Math Laboratory, Far West Regional Laboratory. ) 

Q. Response Model : The C.D.E. answers an LEA service request, expands 
the problem through analysis, suggests solution practices and supports 
over a long period until fully implemented. 

(Example: Rocky Mountain Area Project, San Luis Project) 

Each of these; supplemented by six other recommended models will be analyzed 
in greater detail within the Conclusions section of this report. 



II. Innovation in Colorado 

The Appendix includes a list of 83 innovations that were reported by district 
personnel as being part of their school program, in response to a 19G9 survey 
conducted by the Bureau of Education- Research, University of Denver.! Since 



1 A Survey of Innovative. Education al P ractices in the Public School Districts 
of Colorado , Bureau of Educational Research, University of Denver, 
January, 1970. 



respondents were reacting to a prepared list , it. should not. be thought of as an 
exhaust ive list of all innovative practices in existence in Colorado schools in 
1909. This study yielded several additional innovative practices not explicitly 
mentioned in the University of Denver list. Because of ineonsi standee in 
labeling innovations, it is impossible to determine when the same practice is 
labeled by two different names. Detailed descriptions of which districts have 
adopted which innovations in the past year is available in the C.D. K . --1 Form, 
Fall Re port, 1 969 Sum mary . 



The fourteen "most 
listed below as rope 



utilized innovative programs" in the Slate of Colorado are 
■vied in the previously cited University of Denver report. 



They are listed in their order of frequency with the first being used in 80% of 
the 129 school districts surveyed, while the last was reported in 42% of the 
same sample. 

1. Parent-teacher conferences for reporting pupil progress 

2. Reading Improvement courses (such as speed reading and remedial 
reading) 



3. Paid Teacher Aides 

4. Special Education 

5. Student Aides 



6. BSCS Biology 

7. New Math Programs (other than SMSG and U1CSM) 

8. Individualized Reading 

9. Teacher Visitation Program (schools outside district) 

10. Electronic Language Laboratories 

11. Work Study Programs 

12. Elementary Librarians 

13. Summer School (Remedial) 

14. Team Teaching 



In terms of this present study, the most important finding of the University 
of Denver report was the extremely low number of "innovations" being reported 
as occurring in small school districts (under 1,000 enrollment). It was found 
that, in a sample of 78 . 2 % of all small schools in the state, only five innovations 
from a list of 99 were found in over 50% of the schools reporting. This con- 
trasts significantly with the 52 out of 99 innovations found in the large districts 
(over 5,000 enrollment). 



The present s'udy revealed a doin'. He contrast in the. perceptions of C.D.E. 
personnel and district love! personnel regarding the nature of what they 
classified as "innovations. " The types of innovations mentioned by prac- 
titioners were almost entirely curricular and instructional and emphasized 
individualizing the curriculum and instructional ' "oendures for the stud w it. 

'J'liis held true across all the roles sampled within the .small rural schools 
studied. In contrast personnel in the Colorado Department of Education were 
more likely to mention innovations that were related to planning', development, 
and evaluation of school programs rather than those that dire ctly influenced 
the student, (See Lists J-A and T~B in Appendix. ) 

When asked to describe an improved practice that they are currently involved 
in, practitioners again mentioned primarily those practices that directly touch 
the lire of the student. 

When C.D.E- personnel were asked what improved school practices they are 
currently attempting to diffuse, approximately 2/0 of the respondents delayed 
so long in answering that it was the judgment of the intend ewer that either they Dad 
no personal priority of practices well thought through in advance of the question 
or that the personal priorities of the staff members might be perceived ns in 
conflict with the priorities of the Department, and the staff member was re- 
luctant to voice his own priorities. The former tends to be confirmed by the 
fact tliat half of the respondents could not mention more than four innovations 
and one of those referred to a list before answering. Of the improved school 
practices mentioned, the majority of these would result in changing teacher's 
practices or administrative practices which only indirectly affect student 
activities, (See Lists J-A nndl-B.) 



As might be predicted, a greater proportion of practitioners than C.D.E. 
personnel indicated that they had- a greater understanding of "individualized 
instruction" than of "comprehensive planning." (See Lists II-A and 11—33 . ) 



III. Organizing for Diffusion 

Evidence of the interest in further organizing tire C.D.E. for purposes of 
dissemination and diffusion comes from the establishment of a Dissemination 
and Diffusion Task Force. This unit is to seme as one of seven task force 
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study councils tnfurfbor define and make recommendations on wh::i. is con- 



sidered to bo I ho seven major areas of educational problem :;id/or into rest 
in the State of Colorado. Further evidence of the. interest in refining the. 
diffusion capability of the C.D.L'. is the existence of Project SPREAD. 

SPREAD cxi mo into existence through the caknilnled efforts of a number of 
C.D.E. po ir.onncl who recognized the need for further refining and formalizing 
the diffusion function. 



The Dissemination and Diffusion Task Force has devoted over .105 mnn/days 
to analyzing the existing diffusion function and making recommendations to 
the Achniiii:'.! rativo Council and Commissioner as to further dissemination 
and diffusion activities. 



To further refine its dissemination and diffusion efforts a.s a coordinated 
department effort, the C.D.E. has committed itself to evolve a Dissemination/ 
Diffusion Office out of this temporary Task Force which has been functioning 
on an ad hoc basis for the past several months. A possible model of the 
structure of such an office (based on the analysis described in this report) 
will be presented in the Conclusions and Recommendations section of this 
report. 



The dissemination function and the diffusion function were rarely separated in 
documents reviewed and conversations noted. Indeed, the majority of those 
who were asked about diffusion efforts (and their relative success) answered 
in terms of dissemination of information rather than the diffusion of practices. 
Apparently the diffusion story had not been widely told in the Department since 
less than one-third of those responding mentioned a diffusion activity that was 
outside of Ids own realm of responsibility. In sixteen out of forty cases, the 
respondent was not able to promptly identify a single diffusion activity being 
carried out by the C.D.E. or previously having been carried out. The most 
typical number of diffusion efforts mentioned was three. However, over 12% 
of the respondents mentioned only a single diffusion activity (which in many 
cases was actually a dissemination activity). 

Contrasting the responses in Lists I-A and I-B from the standpoint of organi- 
zation, it is possible to conclude that practitioners are better able to request 
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and develop improved practices in cooperative efforts with the C.D.E. than 
is tlie C.D.E. orgjuiizcd to reliably contacts and complete action 

programs with practitioners. List 11--B indicates a practitioner interest in 
additional coop'Ci’ative, organ! zed diffusion programs relying not only on the 
C.D.E. but on other diffusion organizations as well. 



The absence of complete agreement on communicated Department-wide 
priorities in diffusion is evident from the analysis of responses to Question 0 
in List II-A. This is seen as making it difficult for the individual in the 
C.D.E. to allocate Ins time in light of Department priorities, or organize in 
order to maximize the impact on existing diffusion efforts having high priority 
in the Department. 



I.V, Popular Diffusion Activities 

A preponderant belief in workshop-like activities on the part of C.D.E. 
personnel was clearly indicated by List 1-A responses. These answers also 
associate successful diffusion efforts with a specific kind of person; one who 
is a knowledgeable, personable, charismatic, soc i ally-acceptable, experienced, 
individual with a proven record of accomplishment in the area of diffusion. 



Small rural school people, on the other hand, tend to associate successful 
diffusion practices with a group of working teachers and administrators feeling 
their way and finding their way in a gradual, problem-solving process over a 
long period of time, creating solutions to areas of student need. In as many 
cases as not, the activities in the field which were perceived by small rural 
school personnel to be most successful did not directly involve any intervention 
on the part of C.D.E. personnel. They arc, however, anxious to have the 
backing of the C.D. E. if some step in their process (of evolving local 
solutions) is challenged and must be justified. 



V. Perceptions of Costs 

The concept of relative costs of alternate diffusion activities did not occur 
spontaneously in response to Lists I- A and I-R. When asked directly in List 
II- A, the majority of the respondents had difficulty predicting most standard 
cost factors and wore relatively unprepared to proportion out costs in the total 
diffusion effort. 
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Personnel lime, the 1 ariosi, single cost, was not routinely mentioned. The 
cost factor most mentioned was the production of publications and materials, 
the software to be utilized, a relatively minor cost. Analysis of responses to 
List Il-B indicate, that practitioners in small rural schools arc very sens.iti.ve 
to the time that the development and implementation of imprc.vcd practices 
tal es away from managing the district, school or classroom. One could 
conclude that the practitioners are more sensitive to (he cost of diffusion than 
the C.D.E. personnel with notable exceptions. The statements in l.ist II- A 
indicate a. tendency to underestimate the cost of diffusion efforts on the part 
of C.D. E. personnel. 

VI, Perceptions of Effectiveness 

When C.D.E. personnel were asked the extent, to which the diffusion they had 
mentioned had been effective, hi of the 40 responded that it had worked well. 
However, loss (ban half could site any evidence for believing that the diffusion 
liad worked well when asked a direct question about the possible existence of 
such evidence. Most respondents described only a single critical factor that 
accounted for success, rather than multiple critical factors. Approximately 
33% of the respondents were unable to mention a single diffusion effort that 
had failed, or had not yet come about, or were convinced there were no 
failures. It is apparent both from documentation, interviews, and question- 
naires that thorough knowledge of the relative effectiveness of various diffusion 
efforts is not commonplace. Indeed the need to evaluate and follow-up for 
purposes of evaluation was routinely mentioned by all concerned. Additionally, 
the general pattern of response in the C.D.E. was relative to the quant ity or 
number of districts mid schools adopting a given practice, whereas the criteria 
from the viewpoint of the practitioners is the quality of the influence on the 
student. (See List I- A) 

Practitioners often proposed that they would use C.D.E. staff time assisting 
local personnel to evaluate the effectiveness of various changes and practices 
they had recently instituted. This was found to contrast with the fact that they 
were not necessarily anxious to have the C.D.E. cooperate with them in the 
modification of the practice. (Sec List 11—33) 



List 111— A sheds further light on ihe issue of perceived effectiveness. When the 
answers of C.D.E. stnlf judged to be Die most experienced and successful in 
diffusion are contrasted with an equal number of C.D. E. staff with less of a 
proven record of effectiveness, an obvious difference relates to the larger 
number of roles those persons cited as roles they played as members ol the 
C.D.E. staff. The more, effective diffusors play more roles than the less 
effective. Strangely none of the respondents to List III- A cited their role a.s 
diffusor/ehange agent as their primary role in the Department, in fact, none 
mentioned the diffusor role until after he had mentioned at least four others. 



In contrast, to answers to previous lists, in which 'it was noted certain diffusion 
efforts had not been effective; only once in 21 responses to role descriptions 
did one of the C.D.E. staff self- rate himself as below- average in effectiveness. 
Respondents are either unaware of the relative effectiveness with which they- 
play their several roles or are reluctant to discuss it candidly with peers. 



In discussing factors tending to facilitate and constrain their efforts in diffusion, 
the staff judged more effective perceived more facilitating than constraining 
forces within the C.D.E. This in contrast with an equal number of staff 
(judged not- as- effect! vc) who noted more perceived constraining forces within 
the C.D.E. 



When a comparision was made between the planning skills of the more- effective 
C.D.E. staff and the planning skills of the less-effective staff, results favored 
the more-effective group. Wore effective diffusors tend to be more effective 
planners (or vice-versa). 

The most impressive single finding in the third phase of interviewing in the 
C.D.E. related to the relative inability of two staff members most knowledgeable 
about diffusion to reach agreement as to those C.D.E. staff most effective in 
diffusion efforts when prompted to by the analysis team. Agreement could only 
be reached on four out of 20 staff. Objective evidence as the effectiveness of 
most individuals in diffusing improved school practices does not currently exist 
in the C.D.E. 



* 
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Reviewing nil the information collected about the type(s) of influence being 
used by C.D.K. .staff to further (lie diffusion of given practices, it has been 
noted that C.D.L. staff use ] imbed types of influence. Analyzed against 
Dennis' summary of potential l.vpos of influence, (ppr. 1G7-9, Dennis, W. 
Cha ngin g' Organ i z; • ‘ i < > ns , Mow York, McGraw-Hill, 19Gb), it is noted that, 
most .stall’ tend to use only ''coercive, " "export" or "legitimate" influence 
and rarely in combination, where as "referent" and "value" influence are 
viewed by most (lit fusion scholars as more, powerful and pervasive. 

COM C 1 A -DIO NS AMI) HE COM MU MDATIOXS 
Concludin g Sum 1 n :•_> y 

Figure 3 summarize s, in very general terms, some of the major characteristic 
of the diffusion process as it was described and observed in the Colorado De- 
partment of Education. The procedures used in the past arc expressed in 
abbreviated form on the left and should be read as comparative statements 
with their opposites on the right (indicators of an "ideal" diffusion effort). 

The C.D.K. is now somewhere between these two on most items and organ- 
izing to approach the "ideal" in specific instances. There is no implied empha- 
sis intended in the order of presentation. 



It is hoped that Figure 1, (or some adaptation of it), will come to be used as a 
self-evaluation checkli st , to be used periodically in the future by the C.D.E. 
to rate its progress in refining it’s diffusion efforts. 



Recommended Organizational and Functional .Relationships 

To avoid the isol ated diffusion effort that has had a poor record in the research 
literature, a "tot al" diffusion effort is proposed. Figure 2 describes the basic 
elements of a typical S.D.E. diffusion situation and implies the multiple linkages 
that must exist if all the forces for improvement of school practices arc to be 
coordinated into a high-potcntial-diffusion effort. Linking agreements as to 
roles and responsibility must exist between all the elements in Figure 2. 

Among the more obvious are. the representation of the elements on the Advisory 
Board to the Dissemination/Diffusion Unit, the coordinated activity between 
the Field units and other S,n.E. operations and constant coordination of S.D.E. 
diffusion efforts with the efforts of other agencies with a diffusion function. 
Central to the liaison to other diffusion agencies is the innovation information 




I 



FICURE 1 



'*■ 

t 



Pui ninan 1 of Previous end Potential Diffusion Aetivilv 



Nolo: Rend ;ikj "The C.D.E. diffusion effort lends to be. .. (rend item in left 
column) more often than. .. (rend opposiio item in right column ).' 1 



WHA T HAS BE EN 

e> Based on personal background of 
C.D.E. staff 

o Directed at "schools of convenienec" 



0 Coincidental based on personal 
priorities 

© An. isolated C.D.E. effort 



o Sporadic, one-shot and 
fragmented 

(f Emphasizing' planning' and 
adm in i sir ative p radices 



e Prescriptive 



& Intuitive 

® Simplistic, conventional and 
standard approaches 

© Superimposed on existing 
systems 

© Responsive to service requests 
only 

© Process- oriented 

© Dissemination of publications 
and public information 



WHAT M f CIlT BE 

9 Based on rot reived technical 
information 

© Targotlcd on high potential "open" 
schools and districts and subse- 
quently spread to lowcr-polential 
school s 

© Based on systematically determined 
statewide priorities 

© Collaborative with other diffusion 
agcnci cs 

a Coordinated, complete and 
comprehensive 

0 Emphasizing "improving learning 
env i v on m ent " (c u r r ieu 1 ar an d 
instructional) changes more 
directly affecting learners 

9 Diagnostic and subsequently 
prescriptive 

a Documented and visible 

© Imaginative, thorough, and 
impactful 

o Creating "temporary systems" 
for experimentation 

o Programmatic diffusion from high 
potential to lower-potential districts/ 
classrooms 

o Product- oriented 

a Diffusion of improved practices 





FIGURE 2 

Key Functional Relationships in Total Diffusion Tvffo 




center and the coordination of the targctlid communication emanating from 
the 1) i sseminati on/' f )i f fusion Unit, (D/Dl.’) ami those cm;m ding from other 
sources within and from outside the S.D.K. Within the D/DU, closest 
relationships will need to exist between the Coordination Office which is 
scheduling next steps by all concerned, the Technical Office which is evalu- 
ating the effect of recent steps ami the Field Units which are neUu.'Jy carrying 
out the daily intervention to further the efforts to evolve improved school 
practices for recipient classrooms, schools, districts. Hoards of Cooper- 
ative Services. The single most important relationship will he that between 
the recipients of the innovative practices and the D/D Unit, wherein the 



requests of information and service are processed and agreements arc 
readied between all concerned as to necessary next steps in light of recent 



"corrective feedback. " 



In summary, the d/d Unit might be conceived of as primarily a linking organ- 
ization bringing to bear the various resources of related elements of the 
situation. 
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Recommended Ad d it i on al Mode ls 

Seven models describing some of the more popular current C.D.E, diffusion 
strategies were presented in the Findings section. It is recommended that 
C.D.E. personnel consider elements of the following six additional models 
in terms of t heir potential for use in the future. Just as with the previous 
seven models, it is easy to point out overlap and similarities in those to follow. 

The purpose here is to point out the dominant characteristic of a strategy so 
that it can eventually be formalized into a set of replicable procedures to be 
systematically used by S.D.E. staff and others cooperating in diffusion efforts 
on appropriate future occasions. 

A. Successive Approxima tio n iUodel : S.D.E. cooperatively assesses need 
for innovations in recipient districts; ranks available innovations 
according to appropriateness to need; selected LEA's form field units 
to adopt or adapt solutions to negotiated objectives; diffusion efforts 
modified routinely through "corrective feedback," gradually approxi- 
mating the improved conditions sought; resources from many agencies 
coordinated. 

B. Selective Leadership Model ; The S.D.E. actively seeks to influence 

LEA boards in their selection, training and retention of key administrative 
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personnel f|>:i Hieulnvly Snpcrintemh-ni and Assistant Superintendents); 
based upon li:o proven leadership skills and potential for successful 
diffusion aei ions. 



C 



Student Innovo'en* Mod el: 
process lino. :;ii such me;: 
seminars for rural youth : 
Postman) durin;: junior an 



Involving student. represunuiives in tin' diffusion 
ns as "internships" within (he S.D.K., traveling 
and young people assuming leaching' rolo ( a la. 
d senior years. 



D. 



SKA Con traH or Mo del : .SKA establishes a turnkey perform; 
with an outsier agency (private or non-profit) to assist LEA 
of LEA's to determine needs, modify practices, etc. 



i.nro contract 
or groups 



K« I.K'\ Contract or IMo dol ; SKA assists boards and mipoinnt undents in writiig 
turnkey performance contracts between the LKA end outside services for 
"turnkey" assistance resulting in trained school staff and implemented 
ii, novations. 



F. Comple te T urnov er (Mod el: SKA or LKA contracts with outside, agency for 
total package installation and maintenance for selected portions of school 
program. 



Figure 3 analyzes the previous seven models plus the additional six in terms of 
f, six steps in the diffusion process conceptualized by Havelock, 



if 



tfi 



of influence (suggested by Dennis) affecting the potential 



success of any model 

cost levels of each model relative to other models (including additional 
dollars, staff time, recipient time, learner time) 



o observed or predicted effectiveness (based on assumptions in Preface). 



Recom m ended Jntc r venti on Strategics 

Figure 4 lists an incomplete set of intervention strategies commonly used by 
diffusion personnel, summarized from the works of Bcnnis, flav clock and 
others. 



Analysis of C.D.E. diffusion efforts of the past indicated the use of several 
of these, however, rarely have the various "change-agent" strategies been used 
in combinations anti sequences in a comprehensive, thorough major strategy 
(with contingency strategies organized to be used when some aspect of the 
major strategy proves ineffective in a given instance). 

2 Havelock, R. A Co mparative S tudy of the Literature on the Dissemination 
and Utilization of Scientific Know ! edge . HE W/OE /Bureau of Re sea re h 
Project 7-0028, ERIC r ED-029171, July, 1969. 



Recommended Small Rural School Diffusion Models 
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FIGURE 4 



Pop. sib] p Into event i on F I vn logics 
To Re Com hirc.-y i mp A PH A.-don M ode l 



Action Research 
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Authentic F e o db a< *k 
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Brainstorming and Delphi To 


ehnique 




(kmc Study Conferences 
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Charge Agent; External and ! 


eternal 
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6. Collaborative Action Inquiry 

7. Confrontation 

8. Consultation 

9. Derivation Conference 

10. Dialcy ue, Decision. Action 
H. Diffusion., Natural 

12 . Exp err i mental Demonstration 

13 . Fai t Accomp] i 

14. Financial Support 

15. Force Field Analysis 

16. Goal Clarification 

17. Group Obsorvation/Process Analysis 

18. I in man. Re 1 ati ( ms Lab oratory 

19. Inter- organizational Visiting 

20. Leadership Change 

21. Legislated Change 

22. Linkage 

23. Mass Media Dissemination 

24. Multiple Media Approaches 

25. Network Building 

26. Operations Research 

27. Opinion Leadership Utilization 

28. Organizational Development 

29. Overlapping Groups 

30. Packaging for Diffusion 

31. Planning, Programming, Budgeting (PPBS) 

32. Prestige Suggestion 

33. Problem Solving 

34. Product Development 

35. R & D Unit 

36. R, D, & D 

37. Reflection 

38. Research Evaluation 

39. Revitalization 

40. Role Playing 

41. Rotation of Roles 

42. Sensitivity Training Group 

43. Spirit of Inquiry 

44. Successive Approximation 

45. Survey Feedback 

46. System Self- Renewal 

47. Systems Analysis and Development 



Temporary Sy stem s 
Training, Inservice and 
Pro-service 
Translation 
■User Need Surveys 




11 is strongly recommended that more comprehensive sets of strategies be 
incorporated info diffusion efforts in the future raid that inserviee t raining 
be organised to increase flic number of C.D.E. staff competent to use some 
or all of the strategics. 



Recom mend :, i ions to Project SPTjEAf) Pr. r tici pnnts 

The jrrevious sets of recommendations have followed logically from the findings 
of the analysis of the. diffusion activities of the Colorado Department of Edu- 
cation with small rural schools in 1909-70, When compared with the report 
of the Dissemination and Diffusion Task Force » they may be. of value in reorgan 
5 zing selected aspects of the dissemination and diffusion operations of 
C.D.E. 



Project SPREAD has been, and will continue to bo supportive of the efforts of 
the C.D.E. to strengthen its dissemination and diffusion capability. To that 
end, the following re com n i on dat i on s arc made to the Policy Board. Director, 
Staff and State Observers of Project SPREAD: 

e To the extent possible, similar analyses of the other three S.D.E. 
diffusion efforts should be conducted to note any uniquenesses of the 
C.D.E. or any of the other States. 

© Develop and conduct inserviee training for selected S.D.E. staff with 
heavy responsibilities for parts of diffusion efforts now under way or 
planned. 

& Reanalyze the Fall Report - C.D . E. Form 4, 1 900 data in terms of 
small rural schools with unusual Innovation records compared with the 
Report of Innovative Education Practices, thus highlighting the existence 
of "lighthouse’ 1 school programs. 

® Assist iii devising diffusion cost and effectiveness measurement instru- 
ments in order to begin to standardize those Instruments in terms of 
reliability and validity — preparing for the operational test of various 
diffusion models in selected small rural schools. 
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1. The rural schools arc not or, effect:! vc- as they could bo in providing 
quality education for all of the students. 

2. It is possible for rural schools to improve their effectiveness. 

3. Gmail rural schools can become more effective by sensing needs, 
eliminating some practices and not replacing others— as well as 
adopting or adapting new practices. 

A. Latent conflict exists in rural communities .. .but little significant 
educational planning has dealt with this reality; an opportunity still 
exists to resolve latent rural conflict in positive ways... and re- 
search evidence is available for planning constructive management of 
this condition. 

5. Because of the nature of rural communities and decision processes, 
information about improved school practices and research findings 
alone have little influence in local decisions about improved school 
practices . 

6. Useful and lasting changes occur when the change process involves 
those >who are most affected in ways designed to reduce dependence 
upon "outside" persons or agcnci os . . .and residents of rural communitic 
can be expected to participate in such educational change activities. 

7. Responsibility for determining the goals of the schools resides with 
the citizens of the community. Professional educators have a respon- 
sibility to assist citizens in considering a wide range of goals. 

8. School districts and schools should be concerned with the improvement 
of the quality of learning, and a variety of the particular improved 
practices to be introduced into any school or district should be 
determined by the needs of that school or district to improve the 
quality of learning. 

9. Improvements in school practice that are minor adjustments in standard 
practice are not worth the investment. Basic changes that directly 
affect students are to be given preference. 

10. Innovation must be a continuous process in education and not related 
to any single effort to adopt a given practice. 

11. Changes in school practices that produce minor changes (new textbook) 
require less diffusion effort than changes that produce major massive 
changes (individualized instruction, computer assisted instruction). 

12. No educator or educational organization existing today is using 
replicable diffusion procedures that will reliably work and result in 
improved school practices in rural schools. Why and how change occurs 
in school practice needs to be examined much more empirically and 
systematically. Change processes in a social system whose objectives 
are determined by many people at many jurisdictional levels, and 
decisions are made on nonvisible criteria other than the quality of 
the school program, need careful examination. 

13. Diffusion efforts typically do not succeed as planned, however, a 
diffusion effort can be made to eventually succeed through a gradual 
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17 . 



18 . 



19 . 



process of successive approximation of the ultimate objective, guided 
by "corrective feedback." 

A written set of replicable procedure:, can oe produced that 
eventually incure dj ffusior. of a given improved school practice into 
a cji v in school rotting. Those procedures must bo consistent m th 
rer cHii oh evidence from the behavioral soj.jn-.os. 

Strong leadership at the intpr-Viadiato level or state . agency j s re- 
quired to provide impetus for continued linkage, iegitim.u'ar:' on 
support of the processes of need assessment, program .improvement , aru 

•formative evaluation. . . . , . 

The role of the State Education Agency (oE!a) is to assist in im- 
provino the effectiveness of schools and it should, bo a continuing 
one, do si oned to develop a self-renewing capacity in rural scnools . 
State educational agency staffs are administratively and professionally 
in n nc-.ition to help rural school districts, to effect educational 
chance . . .but they now do not possess adequate skills, experiences, and 
resources to assist rural cnanga process activities. 

To provide quality education for students in small rural senoo w , i 
is essential that improved practices be implemented a no_tfa q a njiest 
be accomp lished through a cooperative effort between tlie local agency 

and tlic? oc Am , . n 

Project SPREAD can eventually test the relative effectiveness 0- 
diffusion strateoies to the end cf contributing to the knowledge base 
about cooperative efforts to diffuse improved practices. 
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FCRMATJV? HVALUAi:u;J PL. Ajj FOR 1' iUUPCT SPREAD 



A. Ove rview 

Tiie purpose of SPREAD is to develop and partially test a set of procedures 
(plan or mode.!. ) which, if adopted, will enable small rural schools of Colorado, 

Utah 5 and V/as.iii.ngton to evaluate and improve their operations continuously. That 
is to soy, deal sion-rnakor:; and educators in those districts. v:hilo following the 
SPih-AD procedures will periodically reexamine their instructional program goals to 
if they are still consistent with current priorities set by the community : they 
will monitor nev/ and more effective instructional and administrative procedures 
which have been devised to accomplish those goals j they will replace sene pro- 
cedures) and gradually correct and improve others in order to make the school 
system as a whole increasingly successful and efficient. 

Stated as above, SPREAD'S goals are very ambitious, of course , and will re- 
quire more time, money, trained personnel, and yet- to- be— developed improvement 
technology than will be available during the Project's five years. What the 
Project expects to accomplish during the five years is to develop a prototype — a 
preliminary but workable sot of procedures-- and to demonstrate that they are useful 
and feasible, end that they contribute enough to the increased success and effi- 
ciency of the educational systems they are designed to serve to warrant their con- 
tinued support and development by local and state agencies. 

More specifically, the SPREAD procedures (model or plan) describe cooperative 
efforts in the states of Colorado, Utah, and Washington in which selected person- 
nel of the State Department of Education, educators in local school districts, 
interested citizens in rural communities and staff from other educational agencies 
will form a continuing diffusion organization in order to generate and pass on in- 
formation, knowledge, and coaching about actions required to improve the schools, 
and to assist thorn to take and verify the effectiveness of the actions o 

In previous documents, participants in tho SPREAD Project have referred to th 
cooperative effort as a communi cations network- -a network of carefully defined 
roles and responsibilities, positions, or jobs. A person or group occupying a 
given position or role perforins certain prescribed tasks in the process of 
gathering and transmitting specified items of information to holders of certain 
other positions in the network, and eventually to the decision-makers and educators 
in the community „ It can also be thought of as a network of information, in- 
fluence, invention, and incentives.. 

Two types of information will be gathered and transmitted: 

a 0 Information relating to needed school practices in Colorado, 

Utah, and Washington and in other parts of the country 0 

b. Information relating to how well the diffusion organization 
is operating and what needs to be done to make it operate 
better. 

Some of the information about effective school practices is already being gathered 
by local and state agencies., Other information will be generated by the procedures 
to bo described below. 




.m r-., 



1 



V.'l'i on the diffusion organ! zation (ccnr.unicati or.:: 
properly, the decision makers :in each of the parti c 5 j- 
be provided with a flow of information in the form of 
enable them periodically to: 



network) is operating 
ating school districts 
written reports which 



will 

will 



lo Reassess the current educational needs of their district as 
viewed by interested citizens., o.g. , needs reflected by poor 
reading performance on the part of elementary students, or by 
a high dre pout ratio, or by inability of hi on school graduates 
to perform well in college, the military, vocational training 
programs, or in entry level jobs, etc. 



2. Review information summaries about improved educational practices 
across the country ( some of which may be in the immediate area)---- 
practices designed to solve particular kinds of educational 
problems: information would bo included about such factors as 
the skills cf personnel requirement of a particular instructional 
program, costs, efficiency of learning, etc. 

3. Compare existing school practices in their district with the 
already available alternatives described above. 



4. Select alternatives to replace ineffective existing programs 

or practices, and then to reallocate resources, do the necessary 
training, etc., to install the new program(a) and gradually make 
it (thorn) work through a series of tryouts and revisions. 

5. Monitor the new program ( s ) or practico(s) to make certain they 
are in fact being properly used, or if necessary, that they 
have been modified by staff to fit the particular circumstances 
of the school or district. 

6. Pother continuing data- -informat ion about pupil, performance in 
particular — which will enable school officials and others to 
know how effectively each new (and old) program is working, i.e», 
whether (or not) pupils are learning the habits, knowledge, and 
skills the program was designed to teach, without at the same 
time learning to hate the subject being taught, themselves, the 
program of studies, the teacher, or school in general. 

7. Develop preliminary working plans for estimating costs of 
producing learning in students by means of new instructional 
programs in comparison with costs of existing programs. In 
this Project, cost /effectiveness is defined as costs of pro- 
ducing units of learning divided by units of learning produced — 
since the task of developing sound cost/effectiveness procedures 
is a major project in itself, the SPREAD effort will be limited 
to developing a prototype plan. The plan will include: 

o A set of Assumptions about costs, effectiveness, and 
the relationship between the two. 

0 A list of constraints within which a cost/effectiveness 
program must operate. 
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o A .list of elements ot a plan to oo cost/effecti veness 
analysis. 

o A list of changes in current school practices in small 
rural schools required to implement cost/ effectiveness. 

o Description of the chc.racterir.tics of sites to be used 
in developing a cost/erfectivenoss procedure. 

o a list of specif 5 cations of the types of training required. 

o A summary report on a pilot analysis ox cosl/ei lectivoness. 



B. The Guidebook 



The SPREAD procedures 
be operationally detined in 
Guidebook will: 



(medal or plan) will be described and to a large extent 
a collection of documents called a Guidebook. Ihe 



1. Present the rationale for the cooperative diffusion exfort , 
the sources of that rationale, related studies, belay mis- 
conceptions, answer general questions, etc. 

2. Specify the activities, procedure, or operations to be per- 
formed by persons or groups holding each of the positions m 
the cooperative effort, including those persons whose task 
it will be to make the effort increasingly effective. 

3. Include a number of "training packages," one for each 
position in the organization. 

4. Describe the "formative evaluation" or "corrective feedback 
procedures for: 

a. Checking on and improving the success and ef- 
ficiency of each of the persons or groups 
occupying each of the positions 5 thereby 
gradually improving the effectiveness of the 
cooperative effort as a whole* 

b. Making the Guidebook intelligible to general 
readers. 

c. Periodically revising the SPREAD Project itself. 

In brief, the formative evaluation strategy is as follows: Each of 

the above, e.g., each training package will be first written in 
preliminary form, then tried in the field, then evaluated, then le- 
vised, and the cycle will be repeated until it has been demonstrated 
that a given portion of the Guidebook is effective with members ot 
tne cooperative effort for whom it was designed. Beyond that point, 
revisions will continue to be made, but less frequently. 



C. The Training Packages 

Each training package will consist of the following four components: 



-m 



I 






1 . I n f or m c t 1 o n a t eria Is. 

a. A brief overview of the entire cooperative cl.iffur.ion 
effort . 

b. A statement of the importance to the Project as a whole 
of the particular responsibility, role, or position for 
which a given training pa el: aye has Iron designed — why 
that position is an essential step in a longer process. 

(l) Job descriptions will be developed in the 
system co the duties to be performed will 
be demonstrably effective, and 



(2) Repeatable 



c. Definitions of certain technical concepts which, must be 
understood as general guidelines by ail' members of the 
diffusion organisation in order to facilitate communica- 
tion, etc., such terms as "successive approximation," 
"corrective feedback," "formative evaluation," "revision 
decisions," etc. 

d. A summary of the actual duties to be performed by a per- 
son occupying a given position or a member of a work 
group . 

e. A work schedule, saying what tasks must be performed when — 
what information will be gathered, from what sources, on 
what time schedule, in what form it will be reported, to 
whom, with what effect, and when. The work schedule will 
be used both in training a candidate for a particular 
position, and later in guiding his activities on the job. 

f. A work record* to be kept and used by each person or 
member of a group occupying a given position, and sub- 
mitted weekly (?) showing what was done, the time re- 
quired, and current estimated degree of success. For 
some positions the work record will show that information 
was gathered and transmitted. In other instances, where 
the communication is assigned the task of persuading the 
recipient of this communication to take some action, the 
work report will provide for follow-up steps to find out 
if the proposed action was indeed taken, and remedial 
steps to be taken if it is determined that the task was 
not completed. 

2. "Criterion-Referenced" Tests. These will consist of standardized 
observational or examination procedures sometimes in the form of 
work samples which will enable the trainer to find out what a 
particular candidate for a given position knows about the 
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*Footnote: The formative evaluation strategy calls for a number of weekly or 

monthly reports of which the work record is one example. It is 
assumed that for the most part these reports will consist mainly of 
O checklists and while they will be comprehensive, they will require 

1\K little time to fill in. 
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requirements of that position before training at particular 
points during training, at completion of training, and on 
the job. The examinations will tent the candidate's knowl- 
edge of the basic guidelines, concepts, and detailed pro- 
cedures relating to his job at throe levels of understanding: 

a. H:lg ability to tell — to define or describe verbally. 

b. Hie ability to observe — to differentiate between 
correct and incorrect examples, to find now examples 
of consistent actions in bis daily experience* 

c. His ability to do- -to apply the guidelines and con- 
cepts to his job, actually to carry out specified 
operations and appropriate contingency plans. 

For training, something in the way of performance tests will be 
needed. For on-the-job follow-up, work reports will be used. 

3. Instructional Procedures. These will consist of specifications 
of how and when the informational materials and tests will bo 
used, and of additional learning exercises to be either self- 
administered, or administered by the trainer. 

a. The trainer will tape record, his training sessions 
and this tape, or a copy of it, will become a part 
of the record and will go to the person responsible 
for initiating formative evaluation, a monitor or 
observer . 

b. The trainer will follow a guide sheet which will pro- 
scribe the following training sequence: Pretest; 

presentation of informational material, to be read by 
candidate prior to training sessions; a check test; 
trainer-guided instruction for remedying gaps in a 
candidate's knowledge and misconceptions, as revealed 
by check test; retest; further instruction where re- 
quired; retest: follow-up reports from the job and 
additional instruction and retesting, if necessary. 

c. The trainer will keep a log in which he will report 
the time required for the various training steps; any 
difficulties encountered, such as unclear instructions; 
unexpected reactions from trainees such as emotional 
outbursts, verbal attack; any improvisations he needed 
to moke, noting which were useful. The trainer will 
also present his suggestions for improving the 
materials or the training materials. 

4. Formative Evaluation Materials. These will include some of the 
already mentioned materials, e.g., the examinations and work re- 
ports, and in addition, they will include evaluation forms to be 
completed by each candidate. The candidate will answer the 
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fo] lowing questions rbout each part of the training process, 
and each responsibility , operation, procedure* of the job 
itself s 



a. Was it interesting? How could it bo made more in- 
teresting? 

b. At v/hot points was it difficult? How might, it bo 
made less so? 

c. Were- directions clear? How might they be improved? 

a. What changes in the process would result in the 
saving of time or an increase in satisfaction or 
efficiency? 

D. The Re vi sion Proces s 

1, Training Packages. After a training session or field tryout, the 
monitor or observer will: 

a. Administer the candidates' evaluation forms. 

b. Collect from the trainer the trainer's tape(s) and 
trainer's log. 

c. Listen to and "code" the training tape. He will use a 
prepared coding sheet which will parallel the trainer's 
guide sheet. Both the trainer's guide sheet and the 
coding sheet will list the steps the trainer is expected 
to follow, the questions he is to ask, acceptable answers, 
concepts he is to teach, etc. As the monitor listens to 
the tape, he will make a series of tab marks on his coding 
sheet, one for each of the trainer's verbalizations 
placing that tab mark in the appropriate space on the 
coding sheet to show whether it was the verbalization 
called for by the instructional plan, or an improvisation. 

d. After the coding has been completed, the monitor will 
then fill out the monitor's report form, which will show 
the number, percentage and kind of errors which occurred 
during training, e.g., by kind of errors is meant such 
things as improvisations inconsistent with the guidelines, 
failure to complete all steps, changing the sequence of 
steps, etc. The monitor's report will list his own sug- 
gestions for improvements to be made in a training procedure, 
and will summarize suggestions made on trainer's log and 
candidate's evaluation forms. He will also suggest im- 
provements in his monitoring procedure. 
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The monitor will participate with project director, 
trainer, and the project evaluator in an evaluation 
or "debriefing" session in which the summary of re- 
ports will be presented and discussed, changes in 
materials and training procedures considered, decisions 
mode, etc. 

2. Other Sections of the Gui ..ebook. Sections of the Guidebook not 
consisting of training packages will be evaluated by means of 
pretests and post tests to be completed by selected readers and 
forwarded to project director. This information will be used to 
determine if readers in fact learn from the Guidebook. In addi- 
tion, the readers will provide information about their interest 
level, the extent they were challenged to perform successfully, 
unanswered questions, and. the like. 

I 

3. SPREAD Project as a whole. The project director will, from 
time to time, (how often?) present sections of the Guidebook 
to (whom?) other members of Colorado, Utah, and Washington 
State Departments of Education, to selected local educational 
leaders, and staff of other diffusion agencies for criticisms 
and suggestions. 



In addition the Project's effort will be surveyed periodically by representatives 
of the U. S. Office of Education, the SPREAD Advisory Committee, the Policy Board, 
and professional organizations. 



E . Parallel Staffing 



A standard practice in selecting state agency and rural school district per- 
sonnel for a cooperative effort will be the assignment of at least two people to 
each of the roles and responsibilities in the model. Because of the importance of 
interactions between people in the communications network, the assignment of a 
second person to the same responsibility w ho will act as a replacement in the case 
of the unavailability of the person with the prime responsibility. For purposes 
of formative evaluation, this second person will also act as a devil's advocate 
challenging and questioning the person with the prime responsibility and verifying 
that he has, in fact, accomplished those procedures outlined in the Guidebook. 

Both of these people will receive the same training program and the second, while 
not as continually and deeply involved, will receive periodical briefings by the 
person with the prime responsibility as to actions taken, problems encountered, 
successes and the like. It is in these briefings that the second person will 
verify against the Guidebook the actions of the person with the prime responsi- 
bility. 



F . Next Steps 

1. Time schedule for preparation and tryout of training packages. 

a. Order in which packages will be developed — completion dates. 

b. Field testing sites — dates . 
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Revision sessions. 



G. 



Summar y 

"lhe seven categories of Formative Evaluation data are: 
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eventual ]y successfully, so they can perform the role? The data gathering 
measures consist of pretest, post test, and role-playing experiences judged 
by lists of criteria given to the observer* In addition, the observer 
verifies that persons are acting out in reality the role they played suc- 
cessfully. 

c . Infor mati on a bou t the com rnj tvnc-.nt and p lanning of those trained to carry 
o ut p r ocedures . Are people becoming committed to the roles they wore 
trained for? Mot only do they understand, but they believe in what they 
are doing. This is formative evaluation on the actions of the people 
trained. 

d° I nformation a bout t h e succe ss of actio ns taken . Check to see if people 
assigned to roles actually carry out these roles. Types of evidence 
gathered are: 

(1) Direct observation by the observer of completed actions 
and the existence of tangible products such as a written 
agreement, memo, list, or a note about a phone call, and 
the agreements reached* 

e. Information about .revising the Guidebook . Plans for correcting role 

definition based on field observation. These would be formative evaluation 
used in revising the Guidebook, the descriptions of roles within the Guide- 
book, and the procedures carried out by the persons performing these roles. 
Types of information to be collected would be collected by the observer and 
the diffusion manager in debriefing sessions. It would consist of answers 
to questions such as: 

(l) What did you do? Is that what it said you would do in the 
Guidebook? What problems did you encounter along the way? 

How might we change the procedures to prevent the problem 
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recurring another time? How much *t 5 use did you invest in 
the activity end now rnj ght that ba cut down another time? 

'What did you improvise- (what did you do that you wore not . 
asked to do but is consistent with what you wore asked to 
do)? at suggestions for improving the training can you 
make? What additional suggestions lor improving the 
training can you. make? '"lint additional training would you 
like to have if you were to repeat this activity another 
time? 

(2) It also would include information on the internal con- 
sistency of language and procedure within the rewritten 
Gui debook . 

f . I nf or matl on a bout th e success of th e new pra ct ice a i i d procedur es . 
formative evaluation or. the cor, tinning improved practice or procedures. It 
is information usually collected by the internal change agent (principal). 
Types of information collected are: Problems in the continued use of the 
improved practice. Remedial actions taken to solve these problems. Changes 
in the table of organization, job descriptions, allocation of resources, and 
policy decision making that tend to insure the success of the improved 
practice. The internal change agent reports the information to the School 
Improvement Committee for modification decisions and eventually to the dif- 
fusion manager so that the history of that project and improved practice 
can be summarized. 

g. Information about modifyi n g and imp roving the SPREA D op erations . Formative 
evaluation of Project SPREAD'S project management. Types of information to 
be collected are: 

(1) Feedback sheets to documents. 

(2) Reactions of Advisory Committee members. 

(3) Analysis of the PERT's, the required redrawing (analysis of 
s.iip in schedule) for planned field activities. 

(4) Information from people playing roles in one of the field 
efforts (debriefing interview information about the in- 
adequacies of the process). 

(5) Data about the information requested by the Policy Board 
or individual Chief State School Officers and their re- 
actions to recommendations of the Project Director as 
they affe-.t the decisions made by the Policy Board about 
subsequent operations and commitments. 

(6) Information from the site visitors, the review team, and 
the reaction from the U.S.O.E. Regional Program Officer. 

Questions about the formative evaluation design. Who collects what kind of 
information about which seven formative evaluation categories, in the form 
of which measures, how often, and gives them to whom? 

For example: Garth Sorenson designs a design, observer is 

trained to collect the various kinds of information on 
supplied forms. He collects these typical types, plus others, 
about the seven categories and gives that information to the 
diffusion manager on these schedules. As a result, the 
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Diffusion ."sneger convent: the fo) lowing people in each 
case (different in each case) and makes these types of 
mod x f i call on deci si one , 



H. Definitions 



a. Evaluation i 



t!ii pro cos 



.v.,, .... ..... of ascertaining the decision to be made, selecting 

related information, and collecting and analyzing information in order to 
report summary uVfa useful to decision makers in selecting among alternative: 
This definition is based on the following assumptions: 

(1) Evaluation is a process of gathering information. Past 
definitions of evaluation are inadequate since they do 
not cover the full range of needed activities. These 
definitions have equated evaluation with either measure- 
ment and testing, statements of congruence between per- 
formance and objectives, or professional judgment. None 

of these definitions by itself is sufficient to provide all 
the necessary information or to include the multiplicity of 
activities now regarded as evaluation. . 

(2) The information collection in an evaluation will be used 
mainly to make decisions about an alternative course of 
action, rather than being employed in some other fashion. 

Thus, the manner in which the information is collected, 
as well as the analysis procedures, must be appropriate 
to the needs of the decision maker. This requirement 
might necessitate quite different analyses than that which 
might be employed if the purpose .was understanding the 
education process per so . 

(3) Evaluation information should be presented to the decision 
maker in a form that he can use effectively and designed to 
help rather than confuse or mislead him. 



(4) Different kinds of decisions may require different kinds of 
evaluation procedures. 



iV 1 



b. Evaluation - subjective judgment applied to data revealed by repeated 
measurement of an educational phenomenon. May be thought of as being 
two types: 

(1) Formative Evaluation: Using data collected on a continuing 

basis during product or project development to guide modifi- 
cation of procedures or components for the purpose of immedi- 
ate improvements. 

(2) Surnmative Evaluation: Reporting comparative data when an 

activity is completed for purposes of summary and documentation. 
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APPENDIX 



Summary Outline- of the Specif icati on:, for the Chapters in the Guidebook , "A 
Gun debook to Orgonir.j r.g Cooperative Efforts to Improve Graul.1 Rural Schools. " 

CHAPTER I HO;7 TO USE THIS GU IDE HOOK 

How the Gu 3 do Ho ok is organ.! :• ed -- how it is to be used -- developmental copy- 
right to }>■» or, tab) :i 5 , hr: d — pages to include content, case studies, pertinent 
literature, and graphics -- description of an ideal rural school and an ideal 
state diffusion agency. 

CHAPTER J T i 1 QW SMA LL RURAL S CHO O L I Mi ■•R fM EMC MT S ARE / CCC MPI.I Si H ID 

A. INFORMATION NETWORKS Ah'D APPROPRIATE IMPROVED PRACTICES 

The Six- State Educational Information Retrieval Center and linkages to other 
networks the committee for sifting of improved practices -- and, the concept 
of local organizational self- renewal . 

B. SEA DIFFUSION LINKAGE AND COMMUNITY ORIENTED CHANGE PROCESS 

Havelock's Guidebook to Innovation -- Project SPREAD Diffusion Model -- 
Northwest Regional Educational Laboratories Community Oriented Change Process. 

CHAPTER HI HOW A GENCIES JOIN_ TOGETHER TH PROGRAMS OF SMALL SCHOOL RURAL 
IMPROVEMENT 

Influence vs., control model -- organizational self-renewal at both levels, 
p 1 anned educational improvement -- successive approximation -- corrective feedback -• 
and the uniqueness of the rural setting. 

CHAPTER IV HOW LO CAL DISTRICTS , WHO ARE READY^ VOLUNTEER TO FORM A PARTNERSHIP 



WITH OTHER AGENCIES 



ru 



Criteria by which districts nominate themselves -- priorities by which 
districts are selected — contractual commitments of LEA's and SEA's. 

CHAPTER V HOW STATE AGENCIES ASSIST LOCAL DISTRICTS TO ACHIEVE READINESS TO 
VOLUNTEER FOR PARTNERSHIPS . 

Formation of diffusion linkages — use of trios — preliminary training in 
the school improvement process. 

CHAPTER VI ORGANIZING THE AGENCIES FOR A COOPERATIVE EFFORT 
A. ANALYZING PAST DIFFUSION EFFORTS OF THE SEA 

Analysis of past diffusion practices — study of organizational and structural 
changes required to activate and maintain a diffusion function — cost effectiveness 
cost benefit. 



ERIC 
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Oi i G A] T1 Z J i ' J i H i : . 



SEA K) I' AC JUT ATI: AND MAINTAIN THE DIPT U SIGN FUNCTION 



Project SPREAD Diffusion M. > do ] -- Ron Havelock's linkage perspective -- the 
SEA organ.' -/ed on the bas:i s of school improvement functions vs. an SEA organised 
on the basis of subject matter, content, and special programs. 



CHAPTER VJI 



AND TRAINING THE SEA SUPPCTT TEAM 



Roles and relationships -- consultant ro.l.e vs. the change agent role — 
relationship, diagnosis, acquisition, choosing, acceptance, self-renewal , (Ron 
Havelock) training programs and trainer manuals. 



CHAPTER VI U ORGGITZING AMD TRAINING THE J.OOAJ. IMPROVEMENT FIELD TEAM 



Field coordinator as the outside change agent -- local administrative leader 
as the inside change agent — technical assistance consultant as the outside change 
agent — local staff os the inside change agent — community oriented change proccs 
and the community oriented change team --- Formative Evaluation Plan for Project 
SPREAD and the observer's role ~ user's manual and training programs. 

CHAPTE R TX DEVb iX PIN G THE ROLES CF THE S EA S UPPORT TEAM 

Training, retraining, self- corrective feedback, formative evaluation — 
revision of training programs. 

C HAPTER X D EVELO PING THE ROLFS OF THE LOCAL IMPROVEMENT FIELD TEAM 

Training, training programs, revision of training programs, formative 
evaluation — formative evaluation observer — parallel staffing and monitoring 
roles -- revision of training programs. 

CHAPTER XI BRIEFING THE TEAMS TO THEIR ROLES 



Tear out chapters to the Guidebook -- one day awareness workshops — 
one-day orientation sessions — support efforts, incentives, and reinforcements. 

CHAPTER XII GATHERING INFOR MA TION ABOUT FIELD EFFORTS 

Collection schedules and methods -- observer's reports — cost effectiveness 
data — student attitude and achievement data — diffusion manager's responsibility 
for supervision. 

CHAPTER XIII EVALUATING AND REVISING THE SUPPORT AND FIELD EFFORTS 

Formative Evaluation Plan for Project SPREAD (evaluation for the purpose of 
improvement and revision) — to provide for local self-renewal — to improve 
products, to revise roles, and to change procedures — revision of priorities end 
goals of SEA and LEA. 

CHAPTER XIV EVALUATING AND REVISING THE PROJECT SPREAD MODEL 

Self- corrective mechanism and Formative Evaluation Plan for Project SPREAD. 
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CHAPTER XV F.VAT -H/MT NG A!!D REVISING TIE GUIDE PCCK 

Corrective feedback forme- — sue cocci ve appro: 
fusion efforts . 



CHAPTER XVI EVALUATING /I’D REVISING THE FORMATIVE 



CHAPTER XVII Si;L r -RENEWAL AND INSTITUTIONALIZING 



:i matron -- rnanagonent of di f— 

; H V ALU ATI OP I-ROCEDURh S 
THE ll/PRCVRPFHT PROCESS 



f 
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appendix F 



G! .OSSARY 




There are terms and phraser. used in the publications of Project SPREAD 
which may need to bo clarified for maximum understanding. These are presented 
be low : 



1 . 



COOPER Ai 1'Vii DIFFUSE ON 
di f f un i. c n pr o c. e d ,.ir e s 
SPREAD method 1 * which 



PROCEDURES 

(strategies) developed using 
will Do described in detail i 



Project 
n the 



Guidebook . 



2. COOPER AT 1 V if EFFORTS 

program development or modification by schools, districts, and 
educational agencies which aro mutually developed and 
achieved. 



3. DIFFUSE OM 

total process of implementing the spread of educational innova- 
tions. The process involves information consumption, social 
interaction, and behavioral change through which on innovation 
is incorporated into an individual, o group, or a system. The 
diffusion process includes the ten sub-processes of: l) dis- 

semination, 2) demonstration, 3) adoption, 4) adoption modifica- 
tion, 5) invention, 6) implementation, 7) evaluation, 8) sustaining 
support, 9) institutionalization, and 10) internalization of the 
self- renewing process. 

4. EVALUATION 

subjective judgment applied to data rendered by repeated 
measurement of an educational phenomenon may be thought of as 
being of two types: 

1. Formative Evaluation. Using data collected on a 

, continuing basis during program ox- Project develop- 
ment to guide modification of procedures or com- 
ponents for the purpose of immediate improvements. 

2. Summative Evaluation. Reporting comparative data 
when an activity is completed for the purposes of 
summarization and documentation. 



■4 
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5. IMPROVED PRACTICES 

programs or activities in a school in which measurably better 
student self-image, attitude, or performance is evident. 

6. INNOVATION 

a new (or different) concept, methodology, organization, or 
program that is systematically introduced into the classroom, 
school system, and/or the state. For the purpose of this 
study, an innovation is defined as an approach or program 
perceived as new by the individual or system. 

7. INSTITUTIONALIZE 

when a function, program, or practice is accepted as "belonging" 
so completely that it is not commonly thought of separately. 

Often institutionalized programs are referred to as the " " 

program, (example: Colorado Springs Program.) 

75 

-69- 




B. JOINT EFEORT 

the effort of the three states in the Project — distincui shed 
from cooperative effort of schools, districts, and other 
agencies in program development or modification. 

9 . MOD);], 

a graphic or verbal representation of a complex phenomenon, so 
as to display its totality as well as the related no re of por- 
tions of the whole. In Project SPRliAD, tho Model will he a 
representation of the current working structure to accomplish 
di ff u- ■ on by cooperative efforts. 

10. NEEDS ASSESSMENT 

a routine, formalised, ongoing process to determine whether or 
not there are discrepancies between that which the policy makers 
and individuals in the organization believe ought to be and v.’nat 
is found to be. Any discrepancies found are described as needs. 

1.1, SELF-1? KiTEWAL 

in a person, the ability to be self-motivating and self-actualizing. 
When applied to a system, it correctly would be stated as "over- 
renewing" or a system that provides for its own continuous renewal. 
The self-renewing organizations provide a framework within which 
continuous innovation renewal and rebirth can occur. In Project 
SPREAD, the operational definition is achieved when all the roles 
performed by outside agencies (#1 through #10) are being performed 
in the local district by local persons. Thus, making the small 
rural school more rational, planful, evaluative, and self- 
actualizing. 

12. SUCCESSIVE APPROXIMATION 

a developmental process for achieving an ultimate goal through a 
series of smaller improvements or refinements of portions of the 
phenomenon under development. A logical-deductive, analytical 
breakdown of the total entity into smaller improvable portions. 
Experiments and developmental operations are applied to each, 
abandoning unsuccessful efforts and maximizing the investment in 
those processes and products for which evidence indicates success. 

In Project SPREAD, both the Model and Guidebook will be developed 
in this manner. 
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